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(54) APPARATUS, SYSTEM AND METHOD FOR IMAGE PROCESSING 
(57)Abstract: 

PROBLEM TO BE SOLVED: To provide an apparatus, a system and a method for 
image processing for correcting a distortion of an image at low cost and creating the 
image with high quality in real time. 

SOLUTION: The apparatus for correcting an original image with a distortion comprises 
a horizontal one-dimensional interpolation part 501 for correcting the distortion in a 
horizontal direction, by performing 1 dimensional interpolation calculation by using a 
horizontal corrective parameter Xm indicating a corrective amount in the horizontal 
direction at pixel points composing the original image; and a vertical 1 dimensional 
interpolation part 502 for correcting the distortion in a vertical direction of the original 



image, by performing the 1 dimensional interpolation calculation by using a vertical 
corrective parameter Ym indicating a corrective amount in the vertical direction at 
the pixel points composing the original image. 
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CLAIMS 

[Claim(s)] 
[Claim 1] 

It is an image processing system including an image amendment means to amend 
according to the amendment vector to which the subject-copy image with distortion 
was supplied, 

The image processing system characterized by having a decoding means to decode 
said encoded amendment vector which is supplied from the outside, and to supply said 
decoded amendment vector to said image amendment means. 
[Claim 2] 



The image processing system according to claim 1 further equipped with the decoding 
control means which makes said amendment vector decode alternatively by publishing 
the command according to the input to a user interface to said decoding means. 
[Claim 3] 

It is the image processing system which amends a subject-copy image with distortion, 
A level amendment means to amend the distortion in the horizontal direction of said 
subject-copy image by performing a 1 -dimensional interpolation operation to said 
subject-copy image using the level amendment parameter which shows the horizontal 
amount of amendments in the pixel which constitutes said subject-copy image, 
The image processing system characterized by having a perpendicular amendment 
means to amend the distortion in the perpendicular direction of said subject-copy 
image by performing the 1 -dimensional interpolation operation using the perpendicular 
amendment parameter which shows the amount of amendments of the perpendicular 
direction in the pixel which constitutes said subject-copy image to the image obtained 
by amendment by said level amendment means. 
[Claim 4] 

While said level amendment means sets said subject-copy image horizontally and 
expands and contracts by adjusting spacing in the horizontal direction of the pixel 
which asks for image data by said 1 -dimensional interpolation operation, 
Said perpendicular amendment means is an image processing system according to 
claim 3 which expands and contracts said subject-copy image in a perpendicular 
direction by adjusting spacing in the perpendicular direction of the pixel which asks for 
image data by said 1 -dimensional interpolation operation. 
[Claim 5] 

Said level amendment means, 

A first data acquisition means to acquire the image data in said pixel alternatively 

according to the integer component of said level amendment parameter, 

A first interpolation multiplier generation means to generate a interpolation multiplier 

according to the decimal component of said level amendment parameter, 

A first interpolation operation means to perform said 1 -dimensional interpolation 

operation using said image data acquired by said first data acquisition means and said 

interpolation multiplier generated by said first interpolation multiplier generation 

means is included, 

Said perpendicular amendment means, 

A second data acquisition means to acquire the image data in said pixel alternatively 
according to the integer component of said perpendicular amendment parameter, 
A second interpolation multiplier generation means to generate a interpolation 
multiplier according to the decimal component of said perpendicular amendment 
parameter, 

An image processing system including a second interpolation operation means to 



perform said 1 -dimensional interpolation operation using said image data acquired by 
said second data acquisition means, and said interpolation multiplier generated by said 
second interpolation multiplier generation means according to claim 3. 
[Claim 6] 

It has further a storage means to memorize the level amendment image obtained by 
amendment by said level amendment means, 
Said perpendicular amendment means, 

A data acquisition means to acquire said level amendment image according to said 
perpendicular amendment parameter from said storage means, 

The image processing system according to claim 3 which includes a interpolation 
operation means to perform the 1 -dimensional interpolation operation using said 
perpendicular amendment parameter, to said level amendment image acquired by said 
data acquisition means. 
[Claim 7] 

It is the image processing system which amends a subject-copy image with distortion, 
A perpendicular amendment means to amend the distortion in the perpendicular 
direction of said subject-copy image by performing the 1 -dimensional interpolation 
operation using the perpendicular amendment parameter which shows the amount of 
amendments of the perpendicular direction in the pixel which constitutes said 
subject-copy image to said subject-copy image, 

The image processing system characterized by having a level amendment means to 
amend the distortion in the horizontal direction of said subject-copy image by 
performing the 1 -dimensional interpolation operation using the level amendment 
parameter which shows the horizontal amount of amendments in the pixel which 
constitutes said subject-copy image to the image obtained by amendment by said 
perpendicular amendment means. 
[Claim 8] 

It is an image processing system including an image amendment means to amend 
according to the amendment vector to which the subject-copy image with distortion 
was supplied, 

An encoding means to encode alternatively said amendment vector in the pixel which 
constitutes said subject-copy image, 

The image processing system characterized by having a decoding means to decode 
said encoded amendment vector which is supplied from said encoding means, and to 
supply said decoded amendment vector to said image amendment means. 
[Claim 9] 

An encoding means to encode alternatively the level amendment parameter which is 
the image processing system which amends a subject-copy image with distortion, and 
shows the horizontal amount of amendments in the pixel which constitutes said 
subject-copy image, and the perpendicular amendment parameter which shows the 



amount of amendments of the perpendicular direction in said pixel, 

A level decoding means to decode said encoded level amendment parameter which is 

supplied from said encoding means, 

A level amendment means to amend the distortion in the horizontal direction of said 
subject-copy image by performing the 1 -dimensional interpolation operation using 
said level amendment parameter decoded by said level decoding means to said 
subject-copy image, 

A perpendicular decoding means to decode said encoded perpendicular amendment 
parameter which is supplied from said encoding means, 

The image processing system characterized by having a perpendicular amendment 
means to amend the distortion in the perpendicular direction of said subject-copy 
image by performing the 1 -dimensional interpolation operation using said 
perpendicular amendment parameter decoded by said perpendicular decoding means 
to the image obtained by amendment by said level amendment means. 
[Claim 10] 

Said encoding means, 

The grid division means which carries out grid division of said subject-copy image 
according to the control signal supplied from a user interface, 

It is an image processing system including a parameter compression means to 
compress alternatively said perpendicular amendment parameter in said lattice point, 
and to supply said perpendicular decoding means while compressing alternatively said 
level amendment parameter in the lattice point obtained comparatively more and 
supplying said level decoding means according to claim 9, by said grid. 
[Claim 11] 

Said level decoding means, 

A first figure child decision means to determine the grid frame which surrounds each 
pixel of a generation image corresponding to the grid generated by said grid division 
means, 

Each the frame of said grid determined by said first figure child decision means is 
approximated with a function, and a level parameter calculation means to compute 
said level amendment parameter in each pixel of said generation image using said 
function is included, 
Said perpendicular decoding means, 

A second figure child decision means to determine the grid frame which surrounds 
each pixel of said generation image corresponding to the grid generated by said grid 
division means, 

An image processing system including a perpendicular parameter calculation means to 
approximate with a function each the frame of said grid determined by said second 
figure child decision means, and to compute said perpendicular amendment parameter 
in each pixel of said generation image using said function according to claim 10. 



[Claim 12] 

It is the image processing system according to claim 1 1 to which at least one side 
approximates said at least one grid frame by the n-th polynomial (n is the natural 
number) among said level parameter calculation means and said perpendicular 
parameter calculation means. 
[Claim 13] 

It has further a storage means to memorize the level amendment image obtained by 
amendment by said level amendment means, 
Said perpendicular amendment means, 

A data acquisition means to acquire said level amendment image according to said 
perpendicular amendment parameter from said storage means, 

The image processing system according to claim 9 which includes a interpolation 
operation means to perform the 1 -dimensional interpolation operation using said 
perpendicular amendment parameter, to said level amendment image acquired by said 
data acquisition means. 
[Claim 14] 

It is the image-processing approach which amends a subject-copy image with 
distortion, 

The first step which amends the distortion in the horizontal direction of said 
subject-copy image by performing a 1 -dimensional interpolation operation to said 
subject-copy image using the level amendment parameter which shows the horizontal 
amount of amendments in the pixel which constitutes said subject-copy image, 
The image-processing approach characterized by having the second step which 
amends the distortion in the perpendicular direction of said subject-copy image by 
performing the 1 -dimensional interpolation operation using the perpendicular 
amendment parameter which shows the amount of amendments of the perpendicular 
direction in the pixel which constitutes said subject-copy image to the image obtained 
in said first step. 
[Claim 15] 

adjusting at least spacing in the horizontal direction of the pixel which asks for image 
data by said 1 -dimensional interpolation operation in said first step — said 
subject-copy image - horizontal - setting - expanding and contracting - or 
The image-processing approach according to claim 14 which expands and contracts 
said subject-copy image in a perpendicular direction by adjusting spacing in the 
perpendicular direction of the pixel which asks for image data by said 1 -dimensional 
interpolation operation in said second step. 
[Claim 16] 

It has further the step which makes a storage means memorize the level amendment 
image obtained by amendment in said first step, 
Said second step, 



The data acquisition step which acquires said level amendment image according to 

said perpendicular amendment parameter from said storage means, 

The image-processing approach according to claim 1 4 which contains the 

interpolation operation step which performs the 1 -dimensional interpolation operation 

using said perpendicular amendment parameter to said level amendment image 

acquired in said data acquisition step. 

[Claim 1 7] 

It is the image-processing approach which amends a subject-copy image with 
distortion, 

The first step which carries out grid division of said subject-copy image according to 
the control signal supplied from a user interface, 

It is the second step in the lattice point obtained comparatively more which encodes 
alternatively the amount of amendments of horizontal and a perpendicular direction by 
said grid, 

Said third encoded step which decodes the amount of amendments of horizontal and a 
perpendicular direction, 

The fourth step which performs a 1 -dimensional interpolation operation about the 
horizontal direction of said subject-copy image according to said decoded horizontal 
amount of amendments, 

The image-processing approach characterized by having the fifth step which performs 
a 1 -dimensional interpolation operation about the perpendicular direction of said 
subject-copy image according to the amount of amendments of said perpendicularly it 
was decoded. 
[Claim 18] 
Said third step, 

The grid frame decision step which determines the grid frame which surrounds each 
pixel of a generation image corresponding to the grid generated in said first step, 
The image-processing approach containing said parameter calculation step in each 
pixel which approximates with a function each the frame of said grid determined in 
said grid frame decision step, and constitutes said generation image using said 
function which computes the amount of amendments of horizontal and a 
perpendicular direction according to claim 17. 
[Claim 19] 

The image-processing approach according to claim 18 which approximates said at 
least one grid frame by the n-th polynomial (n is the natural number) in said parameter 
calculation step. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] 

This invention relates to the image processing system, image processing system, and 
the image-processing approach which are used for a video camera, a digital still 
camera, a film-based camera, etc. 
[0002] 

[Description of the Prior Art] 

Conventionally, in the image picturized by the video camera, a digital still camera or a 
film-based camera, etc., distortion had arisen under the effect of the distortion 
aberration property of an image pick-up lens. Although this distortion is not 
conspicuous in a lens highly precise and highly efficient here, when using the case 
where cost uses a low lens, and an optical zoom lens, it is difficult to avoid the effect 
of drawing distortion completely. 
[0003] 

Then, the image processing system which amends this distortion by signal processing 
has been proposed in recent years. Drawing 33 shows the configuration of the image 
processing system 100 in the former. As shown in drawing 33 , the conventional image 
processing system 100 is equipped with a lens 200, an image sensor 300, the 
data-conversion section 400, the signal-processing section 500, an image memory 
600, the control microcomputer 700, the synchronizing signal generation section 800, 
the amendment data table 1010, the Records Department 1 100, the playback section 
1200, and the display system processing section 1300. 
[0004] 

Here, the outline of actuation of the above-mentioned image processing system 100 is 
explained, referring to the flow chart of drawing 34 . At step S1, the analog picture 
signal over a photographic subject 101 is first inputted through a lens 200 and an 
image sensor 300. And at step S2, this analog picture signal is changed into a digital 
picture signal in the data-conversion section 400, and an image 102 is generated. 
[0005] 

Next, in step S3, the signal-processing section 500 performs an amendment operation 
to the image 102 distorted using the distortion amendment vector (only henceforth an 
"amendment vector") stored in the amendment data table 1010. And in step S4, when 
it is judged that the control microcomputer 700 judges whether the input of an image 
is ended, and is not completed, it returns to step S1. 
[0006] 

Although the above is the outline of actuation of the conventional image processing 
system 100 shown in drawing 33 , this actuation is explained in detail below. 
[0007] 



A lens 200 condenses the reflected light from a photographic subject 101, and **** it 
to an image sensor 300. Moreover, an image sensor 300 consists of CCD, a CMOS 
sensor, etc., captures the ****(ed) image, and generates the picture signal of an 
analog. Moreover, the data-conversion section 400 changes into a digital picture 
signal this analog signal supplied from the image sensor 300, and generates an image 
102. On the other hand, the control microcomputer 700 publishes the command which 
orders predetermined actuation according to the input to an external user interface. 
[0008] 

Moreover, the signal-processing section 500 stores in an image memory 600 the 
digital picture signal generated by the data-conversion section 400 according to the 
command supplied from the control microcomputer 700. And after the 
signal-processing section 500 reads the amendment vector corresponding to all the 
pixels beforehand recorded on the amendment data table 1010 from this table and 
acquires a required picture signal from an image memory 600 according to this 
amendment information, it amends distortion of the image 102 outputted from the 
data-conversion section 400 by performing geometrical amendment by the 
two-dimensional interpolation method per this picture signal. 
[0009] 

Here, the picture signal generated in the signal-processing section 500 is recorded on 
the media 1400, such as a tape, and an external disk or memory, by supplying the 
display system processing section 1300 by displaying this image on a monitor or 
supplying the Records Department 1100. Moreover, the picture signal recorded on 
media 1400 is reproduced by the playback section 1200, and this playback image is 
displayed on a monitor by supplying this regenerative signal to the display system 
processing section 1300. 
[0010] 

In addition, the synchronizing signal generation section 800 generates an internal 
synchronization signal according to the clock signal CLK supplied from the outside, 
and supplies it to an image sensor 300, the data-conversion section 400, and the 
signal-processing section 10. 
[0011] 

Drawing 35 is the block diagram showing the configuration of the signal-processing 
section 500 shown in drawing 33 . As shown in drawing 35 , the signal-processing 
section 500 contains the timing control section 510, a interpolation phase and the 
input data coordinate count section 520, the data acquisition section 530, the 
interpolation multiplier generation section 540, the data-interpolation count section 
550, the output data buffer 560, and the data write-in section 570. 
[0012] 

The data write-in section 570 writes in the digital picture signal supplied from the 
data-conversion section 400, supplies it to an image memory 600 with a control signal 



Sw, and makes this digital picture signal store to an image memory 600 here. 
[0013] 

Moreover, the timing control section 510 generates control timing signal St according 
to the internal synchronization signal supplied from the synchronizing signal 
generation section 800, and a interpolation phase and the input data coordinate count 
section 520 calculate the coordinate of an output image according to supplied control 
timing signal St, and it supplies the amendment vector demand signal Sa which 
requires the amendment vector over the acquired coordinate to the amendment data 
table 1010. 
[0014] 

The amendment data table 1010 searches for the amendment vector according to the 
amendment vector demand signal Sa on this table to build in, and supplies it to the 
data acquisition section 530 and the interpolation multiplier generation section 540. 
The data acquisition section 530 acquires the data for interpolation according to the 
integer component of the amendment vector outputted from the amendment data 
table 1010 from an image memory 600 by supplying the read-out control signal Sr to 
an image memory 600. In addition, the data acquisition section 530 supplies these 
acquired data for interpolation to the data-interpolation count section 550. 
[0015] 

On the other hand, the interpolation multiplier generation section 540 generates a 
interpolation multiplier according to the decimal component of the amendment vector 
supplied from the amendment data table 1010, and supplies it to the 
data-interpolation count section 550. And the data-interpolation count section 550 
performs a interpolation operation according to the data for interpolation supplied 
from the data acquisition section 530, and the interpolation multiplier supplied from 
the interpolation multiplier generation section 540. In addition, a two-dimensional 
interpolation operation is performed as this interpolation operation. 
[0016] 

Hereafter, the image transformation by two-dimensional interpolation is explained, 
referring to drawing 36 . Drawing 36 (a) shows the image before and after 
two-dimensional interpolation, and drawing 36 (b) shows drawing which expanded a 
part of drawing 36 (a). 
[0017] 

Here, when the arrow head which connects from the point a1 shown in drawing 36 (a) 
to the point a4 is an output image, the point for example, on the image 102 which 
corresponds by the point a4 from the point a1 which constitutes this output image is 
carried out to from a point A1 to point A4. Therefore, the case where the 
subject-copy image which consists of an arrow head which connects from the point 
A1 to point A4 with drawing 36 (a) is changed into the output image to which from the 
point a1 to the point a4 is connected with two-dimensional interpolation is shown. 



[0018] 

When determining the image of each point of an output image using two image data 
(2x2) in x and the direction of y, respectively at this time, the image data of a point a1 
is determined using the image data in the four lattice points K00, K01, K10, and K1 1 
surrounding a point A1 . In addition, even if it attaches by point A4 from a point A2, the 
image data of a point a2 to the point a4 is determined by performing the same 
operation. Here, the four above-mentioned lattice points K00, K01, K10, and K1 1 are 
determined according to the amendment coordinate outputted from the amendment 
data table 1010. 
[0019] 

Moreover, as shown in drawing 36 (b), when both distance between the lattice point 
K00 and the lattice point K10 and between the lattice point K10 and the lattice point 
K11 is set to 1, the location of the point A1 in x directions and the direction of y is 
pinpointed with the decimal parameters Px and Py, respectively. At this time, the 
weighting (interpolation multiplier) Cn (n=1-4) of each image data of the lattice points 
K00, K01, K10, and K11 used in case the image data of a point a1 is computed is 
determined, the decimal components Px and Py, i.e., these decimal parameters, of the 
above-mentioned amendment vector supplied from the amendment data table 1010. 
[0020] 

Moreover, the data obtained as a result of the interpolation operation by the 
data-interpolation count section 550 are held at the output data buffer 560, and are 
outputted to the display system processing section 1 300 or the Records Department 
1 100 to predetermined timing. 
[0021] 

Here, the conventional data-interpolation count section 550 is constituted as shown 
in drawing 37 . In addition, in drawing 37 , a configuration in case the image of each 
point of an output image is determined using the image data which consists of a total 
of (4x4) 16 pieces located in a line in x and the direction of y four, respectively is 
shown. 
[0022] 

As shown in drawing 37 , the conventional data-interpolation count section 550 Four 
Rhine memory 900, A total of 16 registers 901 by which the series connection was 
carried out four [ at a time ] to the output node of each Rhine memory 900, 
respectively, 16 multiplication circuits 902 which carry out the multiplication of the 
image data outputted from each register 901, and the corresponding interpolation 
multiplier CHn (n=00~33), respectively, The adder circuit 904 adding the data obtained 
by the multiplication circuit 902 of these 16 individuals and the division circuit 905 
which does the division of the data obtained by the adder circuit 904 are included. 
[0023] 

[Problem(s) to be Solved by the Invention] 



However, according to the above conventional image processing systems, although 
distortion of an image can also be amended on real time, since it is necessary to have 
an amendment vector corresponding to all pixels, a circuit scale becomes large, and 
there is a problem that cost starts. 
[0024] 

Furthermore, since it is necessary to update an amendment vector according to 
change of the distortion aberration property of this lens to perform the case where 
the location of a lens 200 is fluctuated, and lens exchange, the mass amendment data 
table 1010 with high cost is needed. 
[0025] 

Moreover, although renewal of this of the amendment data table 1010 is performed by 
the control microcomputer 700 with the directions from a user interface, since big 
channel capacity is needed between the control microcomputer 700 and the 
amendment data table 1010, it also has the problem that a real-time operation with 
the control microcomputer 700 becomes difficult. 
[0026] 

In addition, although there is also a method of calculating this amendment vector 
serially instead of having the amendment data table 1010, by the approach of starting, 
a real-time operation without the so-called frame delay is difficult, and in order to 
realize a real-time operation, there is a problem that big hardware is needed and cost 
starts. 
[0027] 

Moreover, as mentioned above, by two-dimensional interpolation, in order to amend 
the image data of one point, the image data in two or more points on the 
two-dimensional flat surface in which an image is formed is used, but since the image 
data in many points is needed in order to obtain a high quality image, the access 
frequency to an image memory 600 becomes high, and there is a problem that 
improvement in the speed of operation cannot be attained. 
[0028] 

Moreover, in performing two-dimensional interpolation, it is needed that it is the 
bandwidth whose port width of an image memory 600 is several times the output rate. 
That is, for example, in generating 1 -pixel image data from 4-pixel image data in 
two-dimensional interpolation, it is needed that it is this 4 times [ with a bandwidth of 
1 pixel ] port width of this. 
[0029] 

Thus, since certain conditions are needed for this port width when performing 
two-dimensional interpolation, there is a problem that it is difficult to obtain a high 
definition image from it being very difficult to use the high efficiency filter of a high 
order tap (a "tap" means the number of data in the one direction made into the object 
of an image processing). 



[0030] 

This invention was made in order to solve the above problems, and it amends 
distortion of an image by low cost, and it aims at offering the image processing system, 
image processing system, and the image-processing approach for generating a quality 
image on real time. 
[0031] 

[Means for Solving the Problem] 

The purpose of this invention is an image processing system including an image 
amendment means amend according to the amendment vector to which the 
subject-copy image with distortion was supplied, and is attained by providing the 
image processing system characterized by to have a decoding means decodes the 
encoded amendment vector which is supplied from the outside, and supply the 
decoded amendment vector to an image amendment means. 
[0032] 

While decoding the encoded amendment vector which is supplied from the outside 
according to such a means, in order that an image amendment means may amend a 
subject-copy image according to this decoded amendment vector, the need of holding 
beforehand the amendment vector in all the pixels that constitute a subject-copy 
image in an image processing system is avoided. From this, the equipment scale and 
manufacturing cost of an image processing system which amend a subject-copy 
image with distortion on real time can be reduced. 
[0033] 

Here, this amendment is realizable using the suitable amendment vector according to 
the incorporation environment of a subject-copy image called a location, a hand 
deflection, etc. of a lens by having further the decoding control means which makes an 
amendment vector decode alternatively by publishing the command according to the 
input to a user interface to a decoding means. 
[0034] 

Moreover, by performing a 1 -dimensional interpolation operation to a subject-copy 
image using the level amendment parameter which the purpose of this invention is an 
image processing system which amends a subject-copy image with distortion, and 
shows the horizontal amount of amendments in the pixel which constitutes a 
subject-copy image As opposed to the image obtained by amendment by level 
amendment means to amend the distortion in the horizontal direction of a 
subject-copy image, and the level amendment means By performing the 
1 -dimensional interpolation operation using the perpendicular amendment parameter 
which shows the amount of amendments of the perpendicular direction in the pixel 
which constitutes a subject-copy image, it is attained by offering the image 
processing system characterized by having a perpendicular amendment means to 
amend the distortion in the perpendicular direction of a subject-copy image. 



[0035] 

According to such a means, a level amendment means performs a 1 -dimensional 
interpolation operation to the horizontal direction of a subject-copy image, and since 
a perpendicular amendment means performs a 1 -dimensional interpolation operation 
to the perpendicular direction of this subject-copy image, it can amend distortion of a 
subject-copy image on real time by low cost. 
[0036] 

In addition, amendment by the level amendment means and the amendment by the 

perpendicular amendment means may make whichever perform previously 

[0037] 

The purpose of this invention namely, by performing the 1 -dimensional interpolation 
operation using the perpendicular amendment parameter which shows the amount of 
amendments of the perpendicular direction in the pixel which constitutes a 
subject-copy image to a subject-copy image As opposed to the image obtained by 
amendment by perpendicular amendment means to amend the distortion in the 
perpendicular direction of a subject-copy image, and the perpendicular amendment 
means By performing the 1 -dimensional interpolation operation using the level 
amendment parameter which shows the horizontal amount of amendments in the pixel 
which constitutes a subject-copy image It can attain also by offering the image 
processing system characterized by having a level amendment means to amend the 
distortion in the horizontal direction of a subject-copy image. 
[0038] 

When a level amendment means adjusts spacing in the horizontal direction of the pixel 
which asks for image data by the 1 -dimensional interpolation operation, while setting a 
subject-copy image horizontally and expanding and contracting in the above A 
perpendicular amendment means can realize expansion or contraction of a 
subject-copy image easily with the thing which expands and contracts a subject-copy 
image in a perpendicular direction, then distortion amendment by adjusting spacing in 
the perpendicular direction of the pixel which asks for image data by the 
1 -dimensional interpolation operation. 

[0039] Moreover, a first data acquisition means by which a level amendment means 
more specifically acquires the image data in a pixel alternatively according to the 
integer component of a level amendment parameter, A first interpolation multiplier 
generation means to generate a interpolation multiplier according to the decimal 
component of a level amendment parameter, A first interpolation operation means to 
perform a 1 -dimensional interpolation operation using the image data acquired by the 
first data acquisition means and the interpolation multiplier generated by the first 
interpolation multiplier generation means is included. A second data acquisition means 
by which a perpendicular amendment means acquires the image data in a pixel 
alternatively according to the integer component of a perpendicular amendment 



parameter, A second interpolation multiplier generation means to generate a 
interpolation multiplier according to the decimal component of a perpendicular 
amendment parameter, A second interpolation operation means to perform a 
1 -dimensional interpolation operation using the image data acquired by the second 
data acquisition means and the interpolation multiplier generated by the second 
interpolation multiplier generation means shall be included. In addition, let the 
above-mentioned decimal component be a interpolation phase. 
[0040] 

Moreover, it has further a storage means memorize the level amendment image 
obtained by amendment by the level amendment means, and a perpendicular 
amendment means shall contain in the above a data-acquisition means acquire the 
level amendment image according to a perpendicular amendment parameter from a 
storage means, and a interpolation operation means give the 1 -dimensional 
interpolation operation using a perpendicular amendment parameter to the level 
amendment image acquired by the data-acquisition means. 
[0041] 

According to such a means, since only a level amendment image required for a vertical 
1 -dimensional interpolation operation is alternatively acquired from a storage means 
by the data acquisition means, this 1 -dimensional interpolation operation can be 
performed efficiently. 
[0042] 

Moreover, the purpose of this invention is an image processing system including an 
image amendment means to amend according to the amendment vector to which the 
subject-copy image with distortion was supplied. An encoding means to encode 
alternatively the amendment vector in the pixel which constitutes a subject-copy 
image, It is attained by offering the image processing system characterized by having 
a decoding means to decode the encoded amendment vector which is supplied from 
an encoding means, and to supply the decoded amendment vector to an image 
amendment means. 
[0043] 

Since a subject-copy image is amended according to this amendment vector by which 
the decoding means decoded the amendment vector encoded by the encoding means, 
and the image amendment means was decoded according to such a means, distortion 
amendment can be performed without using the amendment vector in all the pixels of 
a subject-copy image, and a subject-copy image can be amended on real time by low 
cost. 
[0044] 

Moreover, the level amendment parameter which the purpose of this invention is an 
image processing system which amends a subject-copy image with distortion, and 
shows the horizontal amount of amendments in the pixel which constitutes a 



subject-copy image, An encoding means to encode alternatively the perpendicular 
amendment parameter which shows the amount of amendments of the perpendicular 
direction in a pixel, A level decoding means to decode the encoded level amendment 
parameter which is supplied from an encoding means, By performing the 
1 -dimensional interpolation operation using the level amendment parameter decoded 
by the level decoding means to a subject-copy image A level amendment means to 
amend the distortion in the horizontal direction of a subject-copy image, and a 
perpendicular decoding means to decode the encoded perpendicular amendment 
parameter which is supplied from an encoding means, By performing the 
1 -dimensional interpolation operation using the perpendicular amendment parameter 
decoded by the perpendicular decoding means to the image obtained by amendment 
by the level amendment means It is attained by offering the image processing system 
characterized by having a perpendicular amendment means to amend the distortion in 
the perpendicular direction of a subject-copy image. 
[0045] 

According to such a means, a level amendment means performs a 1 -dimensional 
interpolation operation to the horizontal direction of a subject-copy image, and since 
a perpendicular amendment means performs a 1 -dimensional interpolation operation 
to the perpendicular direction of this subject-copy image, it can amend distortion of 
an image on real time by low cost. 
[0046] 

The grid division means which carries out grid division of the subject-copy image here 
according to the control signal to which the above-mentioned encoding means is 
supplied from a user interface, While compressing alternatively the level amendment 
parameter in the lattice point obtained by grid division and supplying a level decoding 
means A thing including a parameter compression means to compress the 
perpendicular amendment parameter in the lattice point alternatively, and to supply a 
perpendicular decoding means then a level amendment parameter, and a perpendicular 
amendment parameter can be efficiently supplied to level and a perpendicular 
decoding means. 
[0047] 

Moreover, a first figure child decision means to determine the grid frame which 
surrounds each pixel of a generation image corresponding to the grid generated by the 
grid division means at this time, for example, a level decoding means, Each grid frame 
determined by the first figure child decision means is approximated with a function. A 
level parameter calculation means to compute the level amendment parameter in each 
pixel of a generation image using this function shall be included. A second figure child 
decision means to determine the grid frame which surrounds each pixel of a 
generation image corresponding to the grid generated by the grid division means in the 
perpendicular decoding means, By approximating with a function each grid frame 



determined by the second figure child decision means, and including a perpendicular 
parameter calculation means to compute the perpendicular amendment parameter in 
each pixel of a generation image using this function The level amendment parameter 
and perpendicular amendment parameter which were encoded can be decoded with a 
sufficient precision. 
[0048] 

Here, at least one side shall approximate at least one grid frame by the n-th 
polynomial (n is the natural number) among a level parameter calculation means and a 
perpendicular parameter calculation means. 
[0049] 

Moreover, by performing a 1 -dimensional interpolation operation to a subject-copy 
image using the level amendment parameter which the purpose of this invention is the 
image-processing approach which amends a subject-copy image with distortion, and 
shows the horizontal amount of amendments in the pixel which constitutes a 
subject-copy image As opposed to the image obtained in the first step which amends 
the distortion in the horizontal direction of a subject-copy image, and the first step By 
performing the 1 -dimensional interpolation operation using the perpendicular 
amendment parameter which shows the amount of amendments of the perpendicular 
direction in the pixel which constitutes a subject-copy image, it is attained by offering 
the image-processing approach characterized by having the second step which 
amends the distortion in the perpendicular direction of a subject-copy image. 
[0050] 

Since according to such a means a 1 -dimensional interpolation operation is performed 
to the horizontal direction of a subject-copy image in the first step and a 
1 -dimensional interpolation operation is performed to the perpendicular direction of 
this subject-copy image in the second step, distortion of an image can be amended on 
real time by low cost 
[0051] 

Set a subject-copy image horizontally, and expand and contract, or it sets to the 
second step in the first step here by adjusting spacing in the horizontal direction of 
the pixel which asks for image data by the 1 -dimensional interpolation operation at 
least. By adjusting spacing in the perpendicular direction of the pixel which asks for 
image data by the 1 -dimensional interpolation operation, a subject-copy image can be 
set to the thing expanded and contracted in a perpendicular direction, then a pan at a 
horizontal direction, a perpendicular direction, or both directions, and a subject-copy 
image can be expanded or reduced easily. 
[0052] 

Moreover, the first step which carries out grid division of the subject-copy image 
according to the control signal which the purpose of this invention is the 
image-processing approach which amends a subject-copy image with distortion, and 



is supplied from a user interface, By the grid, the second step in the lattice point 
obtained comparatively more which encodes alternatively the amount of amendments 
of horizontal and a perpendicular direction, The third encoded step which decodes the 
amount of amendments of horizontal and a perpendicular direction, The fourth step 
which performs a 1 -dimensional interpolation operation about the horizontal direction 
of a subject-copy image according to the decoded horizontal amount of amendments, 
It is attained by offering the image-processing approach characterized by having the 
fifth step which performs a 1 -dimensional interpolation operation about the 
perpendicular direction of a subject-copy image according to the amount of 
amendments of the perpendicularly it was decoded. 
[0053] 

According to such a means, efficiently, it is encoded and decoded, and according to 
this decoded amount of amendments, horizontal and since a vertical 1 -dimensional 
interpolation operation is performed, the amount of amendments in each pixel of a 
subject-copy image can realize easily amendment processing [ real time / image / 
subject-copy ]. 
[0054] 

The grid frame decision step which determines the grid frame which surrounds each 
pixel of a generation image here corresponding to the grid by which the third step of 
the above was generated in the first step, If it considers as the thing containing 
horizontal and the parameter calculation step which computes the vertical amount of 
amendments in each pixel which approximates with a function each grid frame 
determined in the grid frame decision step, and constitutes a generation image using a 
function The amount of amendments of the horizontal direction and perpendicularly it 
was encoded can be decoded easily and certainly. 
[0055] 

In addition, in a parameter calculation step, it is possible to approximate at least one 
grid frame for example, by the n-th polynomial (for n to be the natural number) 
[0056] 

[Embodiment of the Invention] 

The gestalt of operation of this invention is explained to it in detail, referring to a 
drawing to below. In addition, a same-among drawing sign shows the same or a 
considerable part. 
[0057] 

Drawin S 1 is the block diagram showing the configuration of the image processing 
system concerning the gestalt of operation of this invention. As shown in drawing 1 , 
the image processing system concerning the gestalt of operation of this invention is 
equipped with an image processing system 2, a pre-treatment equipment 3, and media 
1400, and, in an image processing system 2, a pre-treatment equipment 3 contains the 
amendment parameter encoder 5 and the amendment parameter derivation section 6 



including a lens 200, an image sensor 300, the data-conversion section 400, the 
signal-processing section 10, an image memory 7, the control microcomputer 8, the 
amendment parameter decoder 9, the synchronizing signal generation section 800, the 
Records Department 1100, the playback section 1200, and the display system 
processing section 1300. 
[0058] 

Here, a lens 200 may condense the reflected light from a photographic subject 101, 
may not **** it to an image sensor 300, and may not remain in the lens of a single 
focus, but may have a zoom function. Moreover, an image sensor 300 consists of CCD, 
a CMOS sensor, etc., captures the ****(ed) image according to the internal 
synchronization signal supplied from the synchronizing signal generation section 800, 
and generates an analog picture signal. 
[0059] 

It connects with an image sensor 300, and the data-conversion section 400 changes 
into a digital picture signal the analog picture signal generated by the image sensor 
300 according to the internal synchronization signal supplied from the synchronizing 
signal generation section 800, and generates an image 102. 
[0060] 

The signal-processing section 10 is connected to the control microcomputer 8, the 
data-conversion section 400, an image memory 7, the amendment parameter decoder 
9, and the synchronizing signal generation section 800. And the signal-processing 
section 10 performs amendment processing to this picture signal stored with the 
amount parameter of amendments supplied from the amendment parameter decoder 9 
while storing in an image memory 7 the digital picture signal supplied from the 
data-conversion section 400 according to the command supplied from the control 
microcomputer 8. And the signal-processing section 10 supplies the picture signal 
acquired by this amendment to the display system processing section 1300 and the 
Records Department 1 100. In addition, the signal-processing section 10 is explained in 
detail later. 
[0061] 

On the other hand, the amendment parameter derivation section 6 calculates 
beforehand the amount vector of amendments according to each location of all pixels 
from the data about the distortion aberration of a lens 200 etc. Moreover, it connects 
with the amendment parameter derivation section 6 and a user interface, and the 
amendment parameter encoder 5 compresses the amount vector of amendments 
supplied from the amendment parameter derivation section 6 according to the control 
signals Ln and Lw supplied from the user interface (encoding), and supplies this 
compressed data Pc to the amendment parameter decoder 9. 
[0062] 

In addition, although the operation and the above-mentioned encoding in the 



amendment parameter derivation section 6 serve as a big operation of a load both 
very much, they do not affect the real-time operation by the image processing system 
2 that what is necessary is just to calculate using a personal computer etc. separately. 
[0063] 

Moreover, with the image processing system concerning the gestalt of operation of 
this invention, a pre-treatment equipment 3 is not used as an indispensable 
component, but the gestalt of the various implementation by which the 
above-mentioned compressed data Pc is supplied to the amendment parameter 
decoder 9 from from outside an image processing system 2 is considered the same 
way. 
[0064] 

Moreover, the control microcomputer 8 supplies the positional information of a lens 
200 etc. to the amendment parameter decoder 9 while outputting the command which 
orders predetermined actuation to the signal-processing section 10 according to the 
control signal from a user interface. 
[0065] 

The amendment parameter decoder 9 is connected to the amendment parameter 
encoder 5, the control microcomputer 8, and the signal-processing section 10. And 
the amendment parameter decoder 9 elongates encoded compressed data Pc which 
was supplied from the amendment parameter encoder 5 in the amount parameter of 
amendments corresponding to each pixel according to the information supplied from 
the control microcomputer 8 (decoding), and supplies this amount parameter of 
amendments to the signal-processing section 10. 
[0066] 

Here, the amendment parameter decoder 9 is not based on the interpolation method 
performed in the signal-processing section 10, but supplies the above-mentioned 
amount parameter of amendments to the signal-processing section 1 0. In addition, the 
above-mentioned amendment parameter encoder 5 and the amendment parameter 
decoder 9 are explained in detail later. 
[0067] 

Moreover, it connects with the signal-processing section 10, and the Records 
Department 1100 records the picture signal generated by the signal-processing 
section 10 on the media (record medium) 1400, such as a tape, a flexible disk, DVD 
(digital multi-purpose disk), a hard disk, and memory. In addition, the picture signal 
generated by the signal-processing section 10 can be recorded on media 1400 using 
the Internet, a wireless communication link, etc. 
[0068] 

Moreover, it connects with media 1400, and the playback section 1200 reproduces the 
picture signal stored in media 1400, and supplies it to the display system processing 
section 1300. It connects with the signal-processing section 10 and the playback 



section 1200, and the display system processing section 1300 displays on a monitor 
the picture signal supplied from the signal-processing section 10 or the playback 
section 1200. 
[0069] 

In addition, the synchronizing signal generation section 800 generates an internal 
synchronization signal according to the clock signal CLK supplied from the outside, 
and supplies it to an image sensor 300, the data-conversion section 400, and the 
signal-processing section 10. 
[0070] 

Drawing 2 is the block diagram showing the configuration of the signal-processing 
section 10 shown in drawing 1 . As shown in drawing 2 , the signal-processing section 
10 contains the 1 level-dimensional interpolation section 501 and the 1 -dimensional 
perpendicular interpolation section 502. In addition, the amendment parameter 
decoder 9 contains the image-distortion-correction parameter decoder 33 for x 
directions, and the image-distortion-correction parameter decoder 34 for the 
directions of y including the image memory 601 with which an image memory 7 
consists of a FIFO memory for level processing, and the image memory 602 which 
consists of a line buffer for perpendicular processing. 
[0071] 

In addition, although an image memory 602 shall have only the capacity which can 
store data [ / in several minimum Rhine minutes required in order to realize vertical 
distortion amendment ], it is later mentioned about this point. Moreover, the 
above-mentioned capacity is usually determined according to the frequency of the 
output synchronizing signal supplied to the output data buffer 32. 
[0072] 

And in the 1 -dimensional horizontal interpolation section 501, the 1 -dimensional 
perpendicular interpolation section 502 contains the operation control section 27, a 
interpolation phase and the input data coordinate count section 28, the data 
acquisition section 29, the interpolation multiplier generation section 30, the 
data-interpolation count section 31, and the output data buffer 32 including the data 
write-in section 21, the operation control section 22, a interpolation phase and the 
input data coordinate count section 23, the data acquisition section 24, the 
interpolation multiplier generation section 25, and the data-interpolation count 
section 26. 
[0073] 

Here, the data write-in section 21 is connected to the data-conversion section 400, 
and the operation control section 22 is connected to the synchronizing signal 
generation section 800. Moreover, a interpolation phase and the input data coordinate 
count section 23 are connected to the operation control section 22 and the control 
microcomputer 8, and the data acquisition section 24 is connected to a interpolation 



phase and the input data coordinate count section 23. an image memory 601, and the 
image-distortion-correction parameter decoder 33. Moreover, the interpolation 
multiplier generation section 25 is connected to the image-distortion-correction 
parameter decoder 33. and the data-interpolation count section 26 is connected to 
the data acquisition section 24 and the interpolation multiplier generation section 25 
[0074] 

In addition, an image memory 601 is connected to the data write-in section 21 and the 
data acquisition section 24, and an image memory 602 is connected to the 
data-interpolation count section 26 and the data acquisition section 29. Moreover, the 
image-distortion-correction parameter decoder 33 is connected to a interpolation 
Phase, the input data coordinate count section 23, and the data acquisition section 24 
[0075] 

On the other hand, the operation control section 27 is connected to the synchronizing 
signal generation section 800, and a interpolation phase and the input data coordinate 
count section 28 are connected to the operation control section 27 and the control 
microcomputer 8. Moreover, the data acquisition section 29 is connected to a 
mterpolation phase and the input data coordinate count section 28, an image memory 
602, and the image-distortion-correction parameter decoder 34, and the interpolation 
multiplier generation section 30 is connected to the image-distortion-correction 
parameter decoder 34. Moreover, the data-interpolation count section 31 is 
connected to the data acquisition section 29 and the interpolation multiplier 
generation section 30, and the output data buffer 32 is connected to the 
data-interpolation count section 31 and the synchronizing signal generation section 
800. 

[0076] 

In addition, the output node of the output data buffer 32 is connected to the display 
system processing section 1300 and the Records Department 1100. Moreover, the 
image-distortion-correction parameter decoder 34 is connected to a interpolation 
phase and the input data coordinate count section 28 
[0077] 

In the signal-processing section 10 which has the above configurations, first, the 
1 -dimensional horizontal interpolation section 501 performs a horizontal (x directions) 
1-d.mensional interpolation operation, and the 1 -dimensional perpendicular 
interpolation section 502 performs a vertical (the direction of y) 1 -dimensional 
interpolation operation continuously. Here, the outline of this operation by the 
signal-processing section 10 is explained, referring to drawing 3 . In addition, in 
drawing_3 , the case where the image data of each point of an output image is 
determined using the image data which consists of a total of (4x4) 16 pieces located in 
a line in x and the direction of y four, respectively is illustrated 
[0078] 



And drawing 3 (a) shows that the image data of points B10-B40 was computed by 
amendment of x directions corresponding to the point B1 which constitutes the 
subject-copy image accompanied by distortion - B4, respectively, and drawing 3 (b) 
shows further that the image data of points b1-b4 was computed by amendment of 
the direction of y corresponding to points B10-B40. 
[0079] 

By performing a predetermined interpolation operation to the image data of the four 
lattice points over the point B1 which more specifically, for example, horizontally, 
continued, the image data of a point B10 is computed and the image data of points 
B20-B40 is similarly computed corresponding to point B-2 - B4, respectively. 
[0080] 

Next, as shown in drawing 3 (b), the image data of a point b3 is computed by 
performing a predetermined interpolation operation to the image data in the four 
lattice points in the broken line over the point B30 which continued perpendicularly 
(points K20-K23) to a point B30. Moreover, corresponding to points B10, B20, and 
B40, the image data of points b1, b2, and b4 is computed similarly, respectively. 
[0081] 

Here, the above 1 -dimensional interpolation operations which can be set horizontally 
are realized by the level processing circuit 40 shown in drawing 4 contained in the 
data-interpolation count section 26. As shown in drawing 4 , the level processing 
circuit 40 includes four multiplication circuits 902 which carry out the multiplication of 
the Rhine memory 900, four registers 901 by which the series connection was carried 
out to the output node of the Rhine memory 900, the data outputted from each 
register 901, and the corresponding interpolation multiplier CHk (k=0-3), and the adder 
circuit 903 adding the data obtained by four multiplication circuits 902. 
[0082] 

In addition, although the 1 -dimensional interpolation operation in the above 
perpendicular directions is realized by the circuit shown in drawing 25 mentioned later, 
this is explained in detail later. 
[0083] 

Next, the outline of the actuation of the signal-processing section 10 shown in 
drawing 2 is explained. The image data first inputted into the 1 -dimensional horizontal 
interpolation section 501 from the data-conversion section 400 is written in by the 
data write-in section 21, is supplied to an image memory 601 with a control signal, and 
is written in an image memory 601 according to this write-in control signal. 
[0084] 

At this time, the data acquisition section 24 acquires the image data horizontally 
located in a line from an image memory 601 as data for interpolation according to the 
amount parameter Xm of amendments for x directions supplied from the 
image-distortion-correction parameter decoder 33 by supplying a read-out control 



signal to the image memory 601 for level processing. 
[0085] 

And a horizontal 1 -dimensional interpolation operation is performed using the 
interpolation multiplier to which the data-interpolation count section 26 was supplied 
from the interpolation multiplier generation section 25, and the image memory 602 for 
perpendicular processing stores this result of an operation. 
[0086] 

Next, in the 1 -dimensional perpendicular interpolation section 502, the data 
acquisition section 29 acquires the image data perpendicularly located in a line from 
the image memory 602 for perpendicular processing as data for interpolation 
according to the amount parameter Ym of amendments for the directions of y supplied 
from the image-distortion-correction parameter decoder 34. And a vertical 
1 -dimensional interpolation operation is performed using the interpolation multiplier to 
which the data-interpolation count section 31 was supplied from the interpolation 
multiplier generation section 30, and the output data buffer 32 outputs this result of 
an operation according to an output synchronizing signal. 
[0087] 

In addition, since the interpolation operation performed by the 1 level-dimensional 
interpolation section 501 and the 1 -dimensional perpendicular interpolation section 
502 is considered as a 1 -dimensional interpolation operation as mentioned above, the 
filter of four taps like cubic interpolation or the filter of the number of twist high order 
taps can be used. 
[0088] 

That is, since a circuit simple as mentioned above is realized, a 1 -dimensional 
interpolation operation can obtain a high definition image from the ability of an 
operation with the filter of a difficult high order tap to be realized easily by the 
two-dimensional interpolation operation. In addition, since the general number 
conversion circuit of pixels etc. is made into the circuit which performs 1 -dimensional 
interpolation, it may share this existing circuit to the above-mentioned operation. 
[0089] 

Moreover, although the gestalt of the operation which performs a vertical 
1 -dimensional interpolation operation was explained after performing a horizontal 
1 -dimensional interpolation operation, a vertical 1 -dimensional interpolation operation 
is performed previously conversely, and it may be made to perform a horizontal 
1 -dimensional interpolation operation in the above after that. In addition, the image 
data outputted from the data-conversion section 400 in this case is inputted into the 
1 -dimensional perpendicular interpolation section 502, and after a 1 -dimensional 
perpendicular interpolation operation is performed, it is once stored in the image 
memory 601 for level processing. And a 1 -dimensional horizontal interpolation 
operation is further performed by the 1 -dimensional horizontal interpolation section 



501, distortion is amended completely, and the image data stored in the image memory 
601 in this way is outputted to the exterior of the signal-processing section 10. 
[0090] 

Moreover, it not only applies data processing in the above to one data, but you may 
apply it for every network to a chrominance signal (RGB, YUV). Furthermore, what is 
necessary is just to perform this operation synchronizing with a Vertical 
Synchronizing signal, in performing this interpolation operation to a dynamic image. 
[0091] 

By the way, with image pick-up equipments, such as a video camera and a digital still 
camera, the so-called optical zoom function and a blurring amendment function are 
carried in many cases, if the above-mentioned function performs optical zoom here — 
a call (zoom-in) — being wide (zoom down) — it responds and the distortion property 
of a lens is changed. That is, generally, if a lens 200 moves to the wide sense, slack 
distortion will arise in an image, and if a lens 200 moves to the sense of a call, 
distortion of a spool mold will occur in an image. 
[0092] 

Since image quality deteriorates at this time when this image is not amended by the 
suitable amendment vector according to this optical zoom, the amendment parameter 
decoder 9 has the optimal amount parameter of amendments according to the 
location of a lens chosen. 
[0093] 

Specifically, the amendment parameter decoder 9 decodes alternatively the 
compressed data Pc to which the information which shows the location of a lens 200 
was supplied from reception and the amendment parameter encoder 5 according to 
this positional information from the control microcomputer 8. 
[0094] 

Thus, since according to the image processing system 2 shown in drawing 1 only the 
amount parameter of amendments decoded according to this property is used for a 
interpolation operation when changing the property of a lens 200, the amount of data 
used for this operation can be stopped to the minimum, and a manufacturing cost can 
be reduced as the result. 
[0095] 

Next, the above-mentioned blurring amendment function is explained. There is the 
approach of amending electrically among the approaches of generally amending 
distortion of the image by blurring by performing predetermined processing to the 
approach of controlling the location of a lens etc. like an active prism method or an 
active lens method, and amending this image optically, and the picture signal acquired 
like an active image area method. 
[0096] 

Here, since a lens property is changed according to the location of a lens 200, it is 



difficult for the optical amendment approach for the image processing system 2 

concerning the gestalt of operation of this invention to realize. 

[0097] 

On the other hand, the above-mentioned electric amendment approach is realized by 
signal processing which cuts down some (effective area) images from the whole image 
based on the information on the blurring location detected by the angular-velocity 
sensor etc. In order for the object of an image processing to change according to the 
location of this effective area etc. at this time, it is necessary to change the 
amendment vector used in case a interpolation operation is performed according to 
this object. 
[0098] 

Then, the amendment parameter decoder 9 realizes blurring amendment by decoding 
alternatively further the compressed data Pc to which the information on a blurring 
location was supplied from reception and the amendment parameter encoder 5 
according to this positional information from the control microcomputer 8. 
[0099] 

in addition, a case as the lens 200 was exchanged in the image processing system 2 
concerning the gestalt of this operation — the same — the amendment parameter 
decoder 9 — this — a high-definition image can be easily obtained after decoding this 
compressed data Pc alternatively according to new lens 200 grade, then a parts 
replacement. 
[0100] 

Next, the actuation of the 1 level-dimensional interpolation section 501 shown in 
drawing 2 is explained in detail, referring to the flow chart of drawing 5 and drawing 6 . 
First, the operation control section 22 generates a control timing signal according to 
the internal synchronization signal supplied from the synchronizing signal generation 
section 800. And a interpolation phase and the input data coordinate count section 23 
operate according to the control timing signal supplied from the operation control 
section 22, and calculates the coordinate of the interpolating point in system of 
coordinates in case there is nothing in the image inputted into the signal-processing 
section 10 about distortion with decimal point. 
[0101] 

In step SI, a interpolation phase and the input data coordinate count section 23 
initialize the coordinate at the upper left of the cut-down image CI (Sx, Sy) as a 
coordinate on the image by which distortion amendment was carried out and actual 
size conversion was carried out (x y), as shown in drawing 7 (a), and specifically, it 
supplies the amendment parameter demand signal Rx to the 
image-distortion-correction parameter decoder 33. On the other hand, in step S2, the 
image-distortion-correction parameter decoder 33 asks for the supplied amendment 
parameter demand signal Rx and the amount parameter Xm of amendments 



corresponding to this coordinate (Sx, Sy), and supplies them to the data acquisition 

section 24 and the interpolation multiplier generation section 25. 

[0102] 

The image-distortion-correction parameter decoder 33 is later explained in detail 
here, although ROM (Read Only Memory) is built in, the contrast table between an 
x-coordinate and the amount parameter Xm of amendments may be beforehand 
stored in this ROM, the amount parameter Xm of amendments is approximated as a 
function with an x-coordinate and you may ask for the amount parameter Xm of 
amendments using this function. 
[0103] 

Next, in step S3, the data acquisition section 24 adds the amount vector of 
amendments according to the amount parameter Xm of amendments supplied from 
the image-distortion-correction parameter decoder 33 (Xm, 0) to the coordinate (X, 
Y) supplied from a interpolation phase and the input data coordinate count section 23. 
It means that it searched for in the subject-copy image OI before amendment from 
this as shown in drawing 7 (b), the coordinate (X+Xm, Y), i.e., the amendment vector, 
of the point corresponding to the above-mentioned coordinate (X, Y). 
[0104] 

In addition, the image-distortion-correction parameter decoder 33 searches for the 
above-mentioned amendment vector according to the x-coordinate supplied from a 
interpolation phase and the input data coordinate count section 23, and you may make 
it supply this amendment vector to the data acquisition section 24 instead of the data 
acquisition section 24. 
[0105] 

When it is judged that the data acquisition section 24 is progressing and is not 
changing to step S5 at this time when it judges whether it changed because the 
integral value of an x-coordinate adds Xm and it is judged that it changed, it 
progresses to step S6. 
[0106] 

At step S5, the data acquisition section 24 judges further whether this integral value 
changed two or more, when it is judged that it changed two or more, it progresses to 
step S8, and when it is judged that only 1 changed, it progresses to step S7. On the 
other hand, at step S6, an image memory 601 supplies again the same data for 
interpolation as what was outputted to the front cycle to the data acquisition section 
24 according to the hold signal Sh supplied from the data acquisition section 24. 
[0107] 

In the above, the data acquisition section 24 generates the address of the data which 
should be read from an image memory 601 according to the integral value of x 
components (X+Xm) of the generated amendment vector, and acquires the data for 
interpolation according to this address by supplying a read-out control signal to an 



image memory 601. 
[0108] 

Here, an image memory 601 suspends the above-mentioned increment temporarily by 
supplying a hold signal Sh from the data acquisition section 24 while carrying out the 
sequential output of the data for interpolation according to this address, incrementing 
the address every [ 1 ] from a start address. 
[0109] 

In addition, an image memory 601 may output the continuation data of the 
predetermined number which read from the data acquisition section 24 and made 
reception and this read-out starting address the above-mentioned start address for 
the starting address. 
[0110] 

Here, the above-mentioned hold signal Sh and a read-out starting address are called 
for from the integer component of the amount parameter Xm of amendments 
outputted from the image-distortion-correction parameter decoder 33. 
[0111] 

On the other hand, the interpolation multiplier generation section 25 treats the 
decimal component of the amount parameter Xm of amendments supplied from the 
image-distortion-correction parameter decoder 33 as a phase of a level interpolation 
filter, and generates a interpolation multiplier according to this decimal component. In 
addition, such actuation is applied when the image 102 inputted into the 
signal-processing section 10 is a RGB format. On the other hand, the filter phase of a 
luminance signal Y can treat like [ in a YUV format ] the filter phase of a RGB format, 
and about color-difference-signal Cb/Cr, this phase can be computed by the ability to 
use together not only the decimal component of the amount parameter Xm of 
amendments but an integer component. 
[0112] 

And in step S7, the data-interpolation count section 26 performs a 1 -dimensional 
interpolation operation according to the data for interpolation and the 
above-mentioned interpolation multiplier which were supplied from the data 
acquisition section 24, and progresses to step S9. 
[0113] 

Here, by the above-mentioned 1 -dimensional interpolation operation, as a YUV format 
is shown in drawing 7 (c), it sets horizontally from near the amendment vector (X+Xm, 
Y), and the 8-pixel brightness data Dt are used as data for interpolation, and the 
interpolation operation of eight taps which made the above-mentioned decimal 
component the phase is performed, for example. In addition, it is used as brightness 
data of an output image etc., and a horizontal distortion is amended from this by the 
result obtained by this interpolation operation. 
[0114] 



On the other hand, at step S8, the data acquisition section 24 supplies the skip signal 
sk to a interpolation phase and the input data coordinate count section 23, the 
image-distortion-correction parameter decoder 33, and the data-interpolation count 
section 26, and stops actuation of these interpolation phase and the input data 
coordinate count section 23, the image-distortion-correction parameter decoder 33, 
and the data-interpolation count section 26. 
[0115] 

Here, since the case where 2 pixels or more of main coordinates which actually carry 
out a interpolation operation move is meant when it is judged that the x-coordinate 
changed two or more in step S5, the data output to the image memory 602 by the 
data-interpolation count section 26 is interrupted. Moreover, when 2 pixels or more of 
main coordinates which actually carry out a interpolation operation move, since the 
decimal component (interpolation phase) of the amount parameter Xm of amendments 
outputted from the image-distortion-correction parameter decoder 33 is held to 
degree cycle, actuation of the image-distortion-correction parameter decoder 33 is 
suspended. 
[0116] 

And at step S13, a interpolation phase and the input data coordinate count section 23 
add the enlarging-or-contracting parameter Ha horizontal to an x-coordinate, and it 
progresses to step S2. In addition, this enlarging-or-contracting parameter Ha is 
determined by the ratio of the die length in the horizontal direction of a subject-copy 
image with the distortion to the image after amendment, when expanding an image 
horizontally after amendment, it is made into a value smaller than 1, when reducing 
conversely, it is made into a bigger value than 1 , and in the case of actual size, it is set 
to 1. 
[0117] 

In step S9, the data-interpolation count section 26 stores the obtained image data in 
the image memory 602 which consists of a line buffer for perpendicular processing. 
And at step S1 0, when it judges whether the image data for one line (a part for i.e., the 
number HS of output level pixels) was outputted to the image memory 602 based on 
the x-coordinate of this time [ section / 23 / a interpolation phase and / input data 
coordinate count ] and it is judged that the data for one line were outputted, it 
progresses to step S11, and when it is judged that the data for one line are not 
outputted, it progresses to step S13. 
[0118] 

At step S1 1, while a interpolation phase and the input data coordinate count section 
23 set an x-coordinate to Sx, 1 is added to a y-coordinate. And at step S12, when the 
image data for one frame (i.e., several output vertical-lines minutes) judges further 
whether it was outputted to the image memory 602 based on a y-coordinate and a 
interpolation phase and the input data coordinate count section 23 judge that the data 



for one frame were outputted, actuation is ended, and when it is judged that the data 

for one frame are not outputted, it progresses to step S13. 

[0119] 

As mentioned above, by performing a horizontal 1 -dimensional interpolation operation 
to a subject-copy image with distortion, the 1 -dimensional horizontal interpolation 
section 501 realizes level drawing distortion amendment processing and horizontal 
zooming processing to coincidence, and saves the obtained image in the image 
memory 602 for perpendicular processing. 
[0120] 

In addition, the example of double conversion, such as being based on the 
above-mentioned 1 level-dimensional interpolation, is shown in drawing 8 . Drawing 8 
shows the conversion about a luminance signal here, and the data D0-D9 for 
interpolation, drawing 8 (b), and drawing 8 (f) as which drawing 8 (a) was inputted into 
the signal-processing section 10 show the sampling position and number of data from 
which the amount parameter Xm of amendments, drawing 8 (c), and drawing 8 (d) 
constitute the image after amendment, respectively. 
[0121] 

Moreover, drawing 8 (e) shows the x-coordinate (xt) supplied to the 
image-distortion-correction parameter decoder 33 from a interpolation phase and the 
input data coordinate count section 23, and the x-coordinate (amendment parameter) 
of the amendment vector by which drawing 8 (g) is generated by the data acquisition 
section 24, the address of the data [ in / in drawing 8 (h) / the image before 
amendment ] for interpolation, and drawing 8 (i) show a interpolation phase, 
respectively. 
[0122] 

For example, as shown in drawing 8 , the amount parameter Xm of amendments of the 
data with which an x-coordinate is located in the point of 2.0 in the image after 
amendment is set to 1.25. consequently, the x-coordinate of the corresponding points 
of this point in the image before amendment — this — the amount parameter Xm of 
amendments is added to 2.0, and it asks with 3.25. At this time, the integer component 
(3) of this x-coordinate (3.25) shows the address of these data in the image before 
amendment, and 0.25 shows a interpolation phase. Therefore, it will ask by the 
1 -dimensional interpolation operation which targetted 0.25 two or more continuation 
data with which, as for the luminance signal of the point of 2.0, the x-coordinate in the 
image after amendment has the about three addresses [ x ] in the image before 
amendment for the phase of a level interpolation filter. 
[0123] 

Drawin S 9 is tne timin g chart showing the timing of double conversion, such as having 
been shown in drawing 8 , of operation. Drawing 9 (a) shows the internal 
synchronization signal supplied to the operation control section 22 here. The control 



timing signal with which drawing 9 (b) is generated by the operation control section 22, 
The read-out control signal with which drawing 9 (c) is supplied to an image memory 
601 from the data acquisition section 24, The data for interpolation by which drawing 9 
(d) is inputted into the data acquisition section 24 from an image memory 601, and 
drawin S 9 (e) show the x-coordinate (xt) supplied to the image-distortion-correction 
parameter decoder 33 from a interpolation phase and the input data coordinate count 
section 23, respectively. 
[0124] 

Moreover, drawing 9 (f) shows the amount parameter Xm of amendments outputted 
from the image-distortion-correction parameter decoder 33. The amendment 
parameter with which drawing 9 (g) is generated by the data acquisition section 24, 
the address of the data [ in / in drawing 9 (h) / the image before amendment ] for 
interpolation, The skip signal sk with which a interpolation phase, drawing 9 0), and 
drawing 9 (k) are generated for drawing 9 (i) by the data acquisition section 24. 
respectively, and a hold signal Sh, The data of two taps with which drawing 9 (I) is read 
from an image memory 601, the data with which drawing 9 (m) is outputted to an image 
memory 602 from the data-interpolation count section 26, and drawing 9 (n) show the 
output enable signal by which internal generation is carried out in the 
data-interpolation count section 26, respectively. In addition, in order to simplify 
explanation here, in the interpolation operation for obtaining one data, the data of two 
taps shown in drawing 9 (I) shall be used. 
[0125] 

If a control timing signal is activated high-level according to an internal 
synchronization signal in time of day T1 as shown in drawing 9 (b), as shown in drawing 
9 (e), a interpolation phase and the input data coordinate count section 23 will supply 
the x-coordinate (xt) by which an increment is carried out every [ 1 .0 ] from 0.0 to the 
image-distortion-correction parameter decoder 33 one by one. 
[0126] 

From this, the amendment parameter with which the image-distortion-correction 
parameter decoder 33 asks for the corresponding amount parameter Xm of 
amendments at drawing 9 (f) so that it may be shown, and the data acquisition section 
24 is shown in drawing 9 (g) after that is computed. Here, as shown in drawing 9 (h), 
the data acquisition section 24 specifies the start address of the data for interpolation 
in the image before amendment with 0 from the integer component of this amendment 
parameter. And as shown in drawing 9 (c) and drawing 9 (d), the data acquisition 
section 24 supplies the activated address 0 which read and was specified as 
mentioned above with the control signal to an image memory 601. 
[0127] 

From this, as shown in drawing 9 (d), an image memory 601 outputs the data for 
sequential interpolation to the data acquisition section 24 continuously from the data 



DO corresponding to this start address 0. 
[0128] 

Moreover, as shown in drawing 9 (g) and drawing 9 G). if it judges that the integer 
component of an amendment parameter increased the data acquisition section 24 or 
more by two in time of day T2, the skip signal sk of high level (H) will be generated, and 
a interpolation phase and the input data coordinate count section 23, the 
data-interpolation count section 26, and the image-distortion-correction parameter 
decoder 33 will be supplied. Consequently, as shown in drawing 9 (g) from drawing 9 
(e), while generation actuation of the amendment parameter between 1 cycles is 
suspended from time-of-day T3, as shown in drawing 9 (m) and drawing 9 (n), when an 
output enable signal is inactivated by the low level, the data output from the 
data-interpolation count section 26 to an image memory 602 is suspended. 
[0129] 

Moreover, as shown in drawing 9 (g) and drawing 9 (k), it judges that the integer 
component of the amendment parameter (8.75) generated in time-of-day T four of the 
data acquisition section 24 is the same as the integer component of the amendment 
parameter (8.25) in front of 1 cycle, and a hold signal Sh is activated high-level in 
time-of-day T four. From this, as shown in drawing 9 (I), in time of day T5, the data 
acquisition section 24 acquires the data D8 and D9 for interpolation of the two same 
taps as a front cycle from an image memory 601. 
[0130] 

In addition, drawing 10 shows the example of the expansion conversion by 1 
level-dimensional interpolation like drawing 8 , and drawing 1 1 shows the timing of this 
expansion conversion of operation like drawing 9 . In the example of this expansion 
conversion, as shown in drawing 10 (e), a data number is horizontally expanded 
considering the enlarging-or-contracting parameter Ha with the horizontal data to 2 
to about six as 0.5. Here, as for drawing 10 (b), the point [ interpolating ], i.e., an 
x-coordinate, a data number shows the amount parameter Xm of amendments about 
ten data from 0 to 9, and according [ drawing 10 (f) ] to this expansion shows the 
amount parameter Xm of amendments in ten points of 0.5 spacing that it can set from 
2.0 by 6.5. 
[0131] 

And in such expansion conversion, since the integer component of an amendment 
parameter does not change in time of day T2, T3, T four, and T5 and T6 as shown in 
drawing 1 1 (g), in each time of day, the hold signal Sh between 1 cycles is activated 
high-level. 
[0132] 

Next, the actuation of the 1 -dimensional perpendicular interpolation section 502 
shown in drawing 2 is explained in detail, referring to the flow chart of drawing 12 and 
drawing 13 . First, the operation control section 27 generates a control timing signal 



according to the internal synchronization signal supplied from the synchronizing signal 
generation section 800. And a interpolation phase and the input data coordinate count 
section 28 operate according to the control timing signal supplied from the operation 
control section 27, and calculates the coordinate of the interpolating point in system 
of coordinates in case there is nothing in the image inputted into the 
signal-processing section 10 about distortion with decimal point. 
[0133] 

In step S1, a interpolation phase and the input data coordinate count section 28 
initialize the coordinate at the upper left of the cut-down image CI (Sx, Sy) as a 
coordinate on the image by which distortion amendment was carried out and actual 
size conversion was carried out (x y), as shown in drawing 14 (a), and specifically, it 
supplies the amendment parameter demand signal Ry to the 
image-distortion-correction parameter decoder 34. On the other hand, in step S2, the 
image-distortion-correction parameter decoder 34 asks for the amount parameter Ym 
of amendments corresponding to this y-coordinate according to the supplied 
amendment parameter demand signal Ry, and supplies it to the data acquisition 
section 29 and the interpolation multiplier generation section 30. 
[0134] 

The image-distortion-correction parameter decoder 34 is later explained in detail 
here, although ROM (Read Only Memory) is built in, the contrast table between a 
y-coordinate and the amount parameter Ym of amendments may be beforehand 
stored in this ROM, the amount parameter Ym of amendments is approximated as a 
function with a y-coordinate and you may ask for the amount parameter Ym of 
amendments using this function. 
[0135] 

Next, in step S3, the data acquisition section 29 adds the amount vector of 
amendments according to the amount parameter Ym of amendments supplied from 
the image-distortion-correction parameter decoder 34 (0 Ym) to the coordinate (X, Y) 
supplied from a interpolation phase and the input data coordinate count section 28. 
From this, as shown in drawing 14 (b), it searches for in the subject-copy image OI 
before amendment, the coordinate (X, Y+Ym), i.e., the amendment vector, of the point 
corresponding to the above-mentioned coordinate (X, Y). At this time, the data 
acquisition section 29 generates the address of the data which should be read from an 
image memory 602 according to the integral value of y component (Y+Ym) of the 
generated amendment vector, and supplies it to an image memory 602 with a memory 
control signal. 
[0136] 

In addition, the image-distortion-correction parameter decoder 34 searches for the 
above-mentioned amendment vector according to the y-coordinate supplied from a 
interpolation phase and the input data coordinate count section 28, and you may make 



it supply this amendment vector to data acquisition section 29 grade instead of the 

data acquisition section 29. 

[0137] 

And in step S4, two or more data for interpolation perpendicularly located in a line 
over two or more lines in Coordinate X are outputted to coincidence to the data 
acquisition section 29 according to the above-mentioned address to which the image 
memory 602 for perpendicular processing was supplied. 
[0138] 

Here, an image memory 602 shall be outputted in the data which carried out 
predetermined number continuation from this received start address, without carrying 
out the sequential output of the data for interpolation according to this address, or 
incrementing the address by incrementing reception and this address every [ 1 ] for 
the start address which starts read-out from the data acquisition section 29. Here, 
the above-mentioned start address is called for from the integer component of the 
amount parameter Ym of amendments outputted from the 
image-distortion-correction parameter decoder 34. 
[0139] 

On the other hand, the interpolation multiplier generation section 30 treats the 
decimal component of the amount parameter Ym of amendments supplied from the 
image-distortion-correction parameter decoder 34 as a phase of a perpendicular 
interpolation filter, and generates a interpolation multiplier according to this decimal 
component. 
[0140] 

And in step S5, the data-interpolation count section 31 performs a 1 -dimensional 
interpolation operation according to the data for interpolation and the 
above-mentioned interpolation multiplier which were supplied from the data 
acquisition section 29. In addition, the above-mentioned interpolation operation is not 
applied only when the image 102 inputted into the signal-processing section 10 is a 
RGB format. That is, in a YUV format, when the data density in the perpendicular 
direction of a luminance signal and a color-difference signal is the same, the filter 
phase of a luminance signal can be used also as a filter phase of a color-difference 
signal, and when these data densities differ, the filter phase of a color-difference 
signal is computed by using together not only the decimal component of the amount 
parameter Ym of amendments but an integer component. 
[0141] 

Moreover, in a YUV format, as shown in drawing 14 (c), in a perpendicular direction, 
the 8-pixel brightness data Dt etc. are used as data for interpolation near the 
amendment vector (X, Y+Ym), and the interpolation operation of eight taps which 
made the above-mentioned decimal component the phase is performed. In addition, it 
is used as brightness data and color difference data of an output image, and distortion 



of a perpendicular direction is amended from this by the result obtained by this 

interpolation operation. 

[0142] 

Next, in step S6, the output data buffer 32 outputs the image data obtained by this 
interpolation operation. At step S7, when it judges whether the image data for one line 
(a part for i.e., the number HS of output level pixels) was outputted based on the 
x-coordinate of this time [ section / 23 / a interpolation phase and / input data 
coordinate count ] and it is judged that the data for one line were outputted, it 
progresses to step S8, and when it is judged that the data for one line are not 
outputted, it progresses to step S10. 
[0143] 

At step S8, while a interpolation phase and the input data coordinate count section 28 
set an x-coordinate to Sx, the vertical enlarging-or-contracting parameter Va is 
added to a y-coordinate. On the other hand, at step S10, the enlarging-or-contracting 
parameter Ha horizontal to an x-coordinate is added, and it returns to step S2. In 
addition, the above-mentioned enlarging-or-contracting parameter Va is determined 
by the ratio of the die length in the perpendicular direction of a subject-copy image 
with the distortion to the image after amendment, when expanding an image 
perpendicularly after amendment, it is made into a value smaller than 1, when reducing 
conversely, it is made into a bigger value than 1 , and in the case of actual size, it is set 
to 1. 
[0144] 

In step S9, when the image data for one frame (a part for i.e., the number of vertical 
lines (the number of perpendicular pixels)) judges further whether it was outputted 
from the output data buffer 32 based on a y-coordinate and a interpolation phase and 
the input data coordinate count section 28 judge that the data for one frame were 
outputted, actuation is ended, and when it is judged that the data for one frame are 
not outputted, it progresses to step S10. 
[0145] 

In addition, in the 1 -dimensional interpolation in the above perpendicular directions, 
since it is not accompanied by the interpolation of data or zooming of an image which 
are related horizontally, in the horizontal scan shown in drawing 14 (a), the same 
actuation as a ** cycle is repeated. However, when the amount parameter Ym of 
amendments is large, the time amount which reads the appropriate data for 
interpolation according to the storing location in an image memory 602 may become 
large. In such a case, the data acquisition section 29 supplies the standby signal WT 
activated to a interpolation phase, the input data coordinate count section 28, and the 
image-distortion-correction parameter decoder 34, and interrupts actuation of a 
interpolation phase, the input data coordinate count section 28, and the 
image-distortion-correction parameter decoder 34 in this activity period of the 



standby signal WT. 
[0146] 

As mentioned above, by performing a vertical 1 -dimensional interpolation operation to 
a subject-copy image with distortion, the 1 -dimensional perpendicular interpolation 
section 502 realizes perpendicular drawing distortion amendment processing and 
vertical zooming processing to coincidence, and generates and outputs the image 
which was able to take distortion completely. 
[0147] 

In addition, the example of double conversion, such as being based on the 
above-mentioned 1 -dimensional perpendicular interpolation, is shown in drawing 15 . 
Drawing 15 is a graph which shows the conversion about a luminance signal here, and 
an axis of abscissa shows an x-coordinate and the y-coordinate (Y+Ym) by which the 
axis of ordinate was amended. 
[0148] 

And it sets to drawing 15 , and a y-coordinate shows the point [ x-coordinate / points 
/ ten / of 0.0 to 10.0 ] on the image after amendment in 0, and shows the amount 
parameter Ym of amendments to the point on the subject-copy image corresponding 
to this each point in an arrow head. That is, in the image after amendment, the point of 
a coordinate (1.0 0) is equivalent to the point of a coordinate (1. 0 7.1) in the 
subject-copy image before amendment, and, for example, let a interpolation phase be 
the decimal component 0.1 by 7.1 for the amount parameter of amendments. 
[0149] 

Next, the pre-treatment equipment 3 shown in drawing 1 and the amendment 
parameter decoder 9 are explained in detail. The outline of actuation of a 
pre-treatment equipment 3 and the amendment parameter decoder 9 is explained 
referring to the flow chart shown in drawing 16 first. 
[0150] 

As shown in drawing 16 , at step S1, the amendment parameter encoder 5 reads the 
amount vector of amendments of all pixels from the amendment parameter derivation 
section 6. Next, as shown in step S2, the amendment parameter encoder 5 determines 
the gridline for dividing the amount vector of amendments of these all pixels for every 
partition. In addition, the decision of this gridline is explained in detail later. 
[0151] 

While compressing the amount vector of amendments of each partition into which the 
amendment parameter encoder 5 was divided by this gridline at step S3 and supplying 
the amendment parameter decoder 9 as compressed data Pc, in step S4, an image 
sensor 300 picturizes an image. In addition, this compression of the amount vector of 
amendments is explained in detail later. 
[0152] 

And at step S5, the data-conversion section 400 changes into a digital picture signal 



the analog picture signal generated by this image pick-up. At step S6, the amendment 
parameter decoder 9 determines a grid required for read-out in the signal-processing 
section 10 of the amount parameter of amendments, and normalizes the coordinate 
supplied from the signal-processing section 10 in step S7 according to this grid 
[0153] 

Next, in step S8, the amendment parameter decoder 9 decodes the compressed data 
Pc supplied from the amendment parameter encoder 5 using this grid, and supplies the 
obtained amount parameter of amendments to the signal-processing section 10. And 
in step S9, the signal-processing section 10 performs the interpolation operation to a 
subject-copy image using this amount parameter of amendments. Here, when it is 
judged that actuation of an image processing system 2 is terminated when it judges 
that it judges whether the control microcomputer 8 terminates the input of the 
subject-copy image to the signal-processing section 10 in step S10, and makes it end, 
and this input is not terminated, it returns to step S4. 
[0154] 

Drawin * 17 is the block d,a eram showing the configuration of the amendment 
parameter encoder 5 shown in drawing 1. . As shown in drawing 17 , the amendment 
parameter encoder 5 contains the grid division section 11 and the parameter 
compression zone 12. Here, the grid division section 11 is connected to a user 
interface, and the parameter compression zone 12 is connected to the grid division 
section 11 and the amendment parameter derivation section 6. Actuation of the 
amendment parameter encoder 5 is explained in detail, referring to drawing 23 from 
drawing 18 below. 
[0155] 

First, the grid division section 1 1 determines the gridline for dividing into two or more 
fields the image 102 obtained by the data-conversion section 400. And the parameter 
compression zone 12 supplies the compressed data Pc which was divided by such 
gndline and which compressed the amount vector of amendments of an image for 
every field using the lattice point, and was obtained to the amendment parameter 
decoder 9. 
[0156] 

While the number of the amount vectors of amendments which should be held by the 
amendment parameter decoder 9 is reducible according to such an approach the 
amendment vector of x and the direction of y as well as the case where the amount 
vector of amendments of all points is held can be divided and calculated, and a 
high-speed interpolation operation can be realized. 
[0157] 

The grid division actuation by the grid division section 1 1 shown below at drawing 17 is 
explained. In addition, since it generates in point symmetry to a core (zero), if it is 
made into the object domain of grid division as shown in drawing 18 (a), one fourth of 



the fields Q1, for example, the first quadrant, of an image 102, it is sufficient for the 
distortion of the image 102 generated by the data-conversion section 400 in fact. 
[0158] 

That is, since the above-mentioned distortion is decided by distance from a core, the 
image processing in a first quadrant Q1 is applicable to the image processing in other 
quadrants as it is by reversing the sign of an x-coordinate, a y-coordinate, or its both 
sides. 
[0159] 

There are an approach (equal segmentation) of dividing a predetermined field equally 
in x directions and the direction of y, the approach (exponentiation division) of dividing 
so that the width of face of each grid may serve as a exponentiation of 2, and the 
approach (the optimal division) of dividing in the optimal division location as grid 
division decision approach. 
[0160] 

Here, the grid division section 1 1 is divided into the number of partitions which had the 
image 102 specified by the this specified approach using a grid 50 as the signal Lw 
which specifies the grid division approach from a user interface, and the signal Ln 
which specifies the grid number of partitions are shown in reception and drawing 18 
(b). 

[0161] 

this time a part for the above grids — per amount vector of amendments in the 
lattice point obtained comparatively more, i.e., each direction, (Wgrid width of face) 
every only the amount vector of amendments is used for this interpolation 
operation. In addition, in the above-mentioned exponentiation division, since the 
operation of the amount vector of amendments in each lattice point becomes easy by 
making width of face of a grid into the exponentiation of 2, a circuit scale is mitigable. 
[0162] 

The above-mentioned optimal division approach performed by the grid division section 
1 1 is explained referring to the flow chart of drawing 19 and drawing 20 below. 
[0163] 

At step S1, the scanning direction in an image processing is first determined as x 
directions. Next, at step S2, the amount parameter of amendments of 1 line L1 in the 
screen upper limit shown in drawing 18 (a) is acquired, and the x dependencies of this 
amount parameter of amendments are investigated. And for example, an example of 
the x dependencies of this amount parameter Xm of amendments when setting a 
reference point to x= 0 (x) is shown in drawing 21 (a). 
[0164] 

Fitting [ with step S3 / a target point is set as the method of the 2 pixel right of this 
reference point (zero), and / the all points between a reference point and this target 
point (one partition) / a secondary polynomial (henceforth a "secondary partition 



polynomial") ]. 
[0165] 

In fulfilling the conditions that the difference (it is also called cost) of the value of the 
amount parameter Xm of amendments (x) and the amount of amendments calculated 
by this secondary polynomial is smaller than a predetermined value in this partition at 
this time, 1 pixel of target points is further shifted to the right, and it repeats this cost 
count. Thus, it searches for the maximum point of satisfying the above-mentioned 
conditions (rightward retrieval). 
[0166] 

In step S4, a reference point is shifted at a target point and rightward retrieval in 
degree partition is performed. In addition, by such approach, a sequential decision of 
the points X1 , X2, and X3 shown in drawing 21 (b) is made, and the amount parameter 
Xm of amendments as a function of x (x) is approximated by the secondary polynomial 
for every partition. 
[0167] 

At step S5, when it judges whether a target point is a right end and it is judged that it 
is a right end, while progressing to step S6, when it is judged that it is not a right end, 
it returns to step S3. 
[0168] 

At step S6, a target point is set as the 2-pixel left of this reference point by making 
right end data into a reference point, and leftward retrieval as well as the 
above-mentioned rightward retrieval is performed. And after a certain partition is 
determined by this cost count, in step S7, a reference point is shifted at this target 
point, and leftward retrieval in degree partition is performed. In addition, by such 
approach, a sequential decision of the points X5 and X4 shown in drawing 21 (c) is 
made, and the amount parameter Xm of amendments as a function of x (x) is 
approximated by the secondary polynomial for every partition. 
[0169] 

At step S8, when it judges whether a target point is a left end and it is judged that it is 
a left end, while progressing to step S9, when it is judged that it is not a left end, it 
returns to step S6. 
[0170] 

Next, in step S9, as shown in drawing 21 (d), the point searched for by the 
above-mentioned rightward retrieval is compared with the point searched for by 
leftward retrieval, and it asks for the division location (optimum point) where this 
whole cost serves as min. As shown in drawing 21 (d) here, by comparing a point X4 
with a point X1, a point X6 is determined and a point X7 is determined by comparing a 
point X5 with a point X2. 
[0171] 

At step S10, when it judges whether the retrieval directions of a division location are x 



directions and it is judged that they are x directions, while progressing to step S11, 
when it is judged that it is not x directions but the direction of y, actuation is ended. 
[0172] 

At step S1 1, the amount parameter of amendments of one line in the right end of a 
division object domain is acquired, the y dependency of this amount parameter of 
amendments is investigated, and it returns to step S3. In addition, the function which 
set the reference point to y= 0, made the axis of abscissa the y-coordinate and made 
the axis of ordinate the amount parameter Xm of amendments (y) is similarly indicated 
to be drawing 21 (a), and this retrieval actuation is performed like x directions to this 
function. The grid division section 1 1 determines a division location in x directions and 
the direction of y, respectively in this way, and decides a grid 50. In addition, this fixed 
grid location is supplied to the parameter compression zone 12 as grid information Li. 
[0173] 

The parameter compression zone 12 shown in drawing 17 holds only the amount 
vector of amendments in each lattice point according to the grid information Li 
supplied from the grid division section 11. And the parameter compression zone 12 
determines the segment L2 which constitutes a grid 50 as shown in drawing 22 (a) as 
a processing object. When the x-coordinate of the both ends of a segment L2 is set to 
X0 and X2 here and the amount parameter of amendments in these both ends is set to 
XmO and Xm2, respectively, the relation of the x-coordinate and the amount 
parameter of amendments in each point on a segment L2 is shown like drawing 22 (b). 
At this time, the multipliers calcium, Cb, and Cc which fill the following formulas (1 ) are 
computed by setting X1 and the amount parameter of amendments to Xm1 for the 
x-coordinate in the pixel on a segment L2. 
[0174] 
[Equation 1] 



Ca x XO 2 + Cb x X0 + Cc = XmO 
Ca x X1 2 + Cb x X1 + Cc = Xm1 
Ca xX2 2 +Cb x X2 + Cc = Xm2 



In addition, as shown in drawing 22 (b) and drawing 22 (c), from Xzero to X2, the 
increment only of 1 is carried out and, as for X1, the sequential comparison of the 
difference of the magnitude of the amount parameter of amendments and the 
approximate value by this secondary partition polynomial is carried out in each point 
on a segment L2 one by one. And the x-coordinate and the amount parameter of 



amendments of the point that this difference serves as min are substituted for the 

above-mentioned formula (1) as XI and Xm1, respectively 

[0175] 

The parameter compression zone 12 is supplied to the amendment parameter decoder 
9 here by using these multipliers calcium, Cb, and Cc as compressed data Pc while it 
computes and holds the above-mentioned multipliers calcium, Cb, and Cc about a part 
for the whole line which makes a grid 50. 
[0176] 

Drawlng 23 is the block diagram showing the configuration of the 
image-distortion-correction parameter decoder 33 for x directions shown in drawing 
2 • As shown in drawing 23 , the image-distortion-correction parameter decoder 33 
contains the distortion parameter buffer 61, the grid decision section 62 the 
normalization section 63, the function transducer 64, and the flat-surface 
interpolation section 65. 
[0177] 

Here, the distortion parameter buffer 61 is connected to the control microcomputer 8 
and the amendment parameter encoder 5, and both the grid decision section 62 the 
normal.zation section 63, and the function transducer 64 are connected to the 
d.stortion parameter buffer 61. Furthermore, the grid decision section 62 is connected 
to the signal-processing section 10, and the normalization section 63 is connected to 
the gr,d decision section 62. Moreover, the function transducer 64 is connected to the 
normalization section 63, and the flat-surface interpolation section 65 is connected to 
the funct.cn transducer 64. In addition, the signal-processing section 10 is connected 
to the flat-surface interpolation section 65. 
[0178] 

Although the image-distortion-correction parameter decoder 33 which has the above 
configurations decodes the compressed data Pc supplied from the amendment 
parameter encoder 5 and restores the amount parameter of amendments of x 
directions ,n each point on a screen, it explains this actuation in detail below 
[0179] 

In addition, the image-distortion-correction parameter decoder 34 for the directions 
of V shown in drawing 2 has the same configuration as the 
.mage-d.stortion-correction parameter decoder 33 for x directions, and operates like 
this image-distortion-correction parameter decoder 33 
[0180] 

First, the distortion parameter buffer 61 inputs a command signal Cd from the control 
microcomputer 8 while inputting and storing compressed data Pc, the grid positional 
information Lp which shows the location of the grid corresponding to this compressed 
data Pc, and the lattice constant information Lc which consists of the inverse number 
of the width of face of this grid from the amendment parameter encoder 5 



[0181] 

The grid decision section 62 receives the x-coordinate (xt) and y-coordinate (yt) of a 
point which ask for the image after amendment from the signal-processing section 10 
with the amendment parameter demand signal Rx, and determines the grid frame with 
which this point is included. Here, the grid decision section 62 determines this grid 
frame by comparing the supplied coordinate (xt, yt) with the grid information LI 
supplied from the distortion parameter buffer 61. 
[0182] 

Next, the normalization section 63 normalizes a coordinate (xt, yt) by the following 

formulas (2) in order to perform a interpolation operation predetermined in the range 

of the grid frame determined by the grid decision section 62. however, the coordinate 

of the four corners of the grid frame which includes a coordinate (xt, yt) as shown in 

drawin S 24 (a) nere — (X0, Y0), and (X0, Y2) — and (X2, Y0) (X2, Y2) — it is — ** - 
it assumes. 

[0183] 

[Equation 2] 



px = 



py = 



xt - xo 

X2 - XO 

yt - yo 

Y2 - YO 



(2) 



In addition, the value of 1/(X2-X0) and 1/CY2-Y0) in the above-mentioned formula (2) 
is computed in the grid division section 1 1 contained in the amendment parameter 
encoder 5, and the normalization section 63 receives this value as lattice constant 
information Lc from the distortion parameter buffer 61. From this, a coordinate (px 
py) -s computed by performing the multiplication using the above-mentioned value in 
the normalization section 63. 

[0184] <BR> function transducer 64 asks for amount parameter [ as a function of x or 
y ] of amendments f (x), g (x), m (y), and n (y) in this grid frame that includes a 
coordinate (xt, yt) as shown in drawing 24 (b). Moreover, the function transducer 64 
receives the multipliers calcium, Cb, and Co in each of the four above-mentioned 



functions from the distortion parameter buffer 61 as multiplier information CL 
[0185] 

although the function transducer 64 asks for the amount parameter of amendments of 
the above-mentioned coordinate (xt, yt) using the four above-mentioned functions, in 
order that [ and ] it may collateralize the continuity of the function in x directions and 
the direction of y - this - four functions f, g, m, and n are changed into the 
approximation functions F, G, M, and N in consideration of weighting as shown in the 
following formula (3). In addition, fa, ft. and fc in a formula (3) show the multiplier 
corresponding to the above-mentioned multipliers calcium, Cb, and Cc in Function f, 
and, as for ga, gb, and go, na, nb, and nc of Function m show this multiplier of Function 
n similarly, respectively, as for ma, mb, and mc of Function g 
[0186] 
[Equation 3] 



F(x) =2xfaxx 2 + (fb-fa)xx + fc 
G(x) = 2 x ga x x 2 + (gb-ga) x x + gc 
M(y) = 2 x ma x y 2 + (mb-ma) x y + mc 
N(y) = 2 x na x y 2 + ( n b-na) x y + nc 



(3) 



In addition, the function transducer 64 supplies the coordinate (px, py) supplied from 
the normalization section 63 to the flat-surface interpolation section 65 as it is 
[0187] 

And the flat-surface interpolation section 65 computes the amount parameter Xm of 
amendments in the above-mentioned coordinate (xt, yt) by the following formula (4) 
using the information which shows the functions F, G, M, and N obtained by the 
function transducer 64 and the above-mentioned coordinate (px py) 
[0188] 

[Equation 4] 

Xm = YX{(l-py)xF(px)+pyxG(px)+(1-px)xN(py) + pxxM(py)} 

(4) 



The flat-surface interpolation section 65 is supplied to the signal-processing section 



10 with the enable signal EN which shows that calculation actuation of this parameter 
ended the amount parameter Xm of amendments computed by such approach. In 
addition, the image-distortion-correction parameter decoder 34 for the directions of y 
computes the amount parameter Ym of amendments by the same approach as the 
above, and supplies it to the signal-processing section 10 with an enable signal EN 
[0189] 

In addition, the above-mentioned functions f, g, m, and n which make a grid frame are 
approximated by the secondary partition polynomial as mentioned above, and also, 
generally they may be approximated by the n-th polynomial (n is the natural number) 
[0190] 

Drawing 25 is drawin S showing the configuration of the image memory 602 shown in 
drawin * 2 ' the data acquisition section 29, and the data-interpolation count section 
31. In addition, drawing 25 shows a configuration in case the interpolation operation 
using the image data whose image processing system 2 is 1 6 pixels of a tap (4x4) 
generates the image data of each pixel. 
[0191] 

As shown in drawing 25 , as for an image memory 602, the data acquisition section 29 
contains a control section 80, the A buffer 81, the B buffer 82, the C buffer 83, the D 
buffer 84, the E buffer 85 and the cycle-sharing section 560, and selectors' 96-99 
including the B memory, a selector 67, and five memory 71 only with 1 [ bigger ] than 
the number of perpendicular taps, i.e., A memory, 72, the C memory 73, the D memory 
74, and the E memory 75. In addition, the cycle-sharing section 560 contains selectors 
91-95. 

[0192] 

Here, five buffers (from the A buffer 81 to the E buffer 85) only with more [ as 
mentioned above ] 1 than the number of perpendicular taps and five corresponding 
selectors 91-95, and four selectors 96-99 that are the numbers of perpendicular taps 
will be contained in the data acquisition section 29. 
[0193] 

Moreover, the data-interpolation count section 31 includes four registers 901 and the 

multiplication circuit 902, and an adder circuit 43. 

[0194] 

In the above, a selector 67 is connected to the data-interpolation count section 26 
and a control section 80, and the A memory 71, the B memory 72, the C memory 73, 
the D memory 74, and the E memory 75 are connected to a selector 67 
[0195] 

Moreover, a control section 80 is connected to the image-distortion-correction 
parameter decoder 34. the A buffer 81 is connected to the A memory 71, and the B 
buffer 82 is connected to the B memory 72. Similarly, the C buffer 83 is connected to 
the C memory 73, the D buffer 84 is connected to the D memory 74, and the E buffer 



85 is connected to the E memory 75. 
[0196] 

Moreover, a selector 91 is connected to the A buffer 81, a selector 92 is connected to 
the B buffer 82, and a selector 93 is connected to the C buffer 83. Similarly, a selector 
94 is connected to the D buffer 84, and a selector 95 is connected to the E buffer 85. 
Moreover, selectors 96-99 are connected to five selectors 91-95, respectively. In 
addition, selectors 91-99 are controlled by the control section 80, respectively 
[0197] 

Moreover, a register 901 is connected to selectors 96-99, respectively, and the 
multiplication circuit 902 is connected to each register 901. And as for four 
multiplication circuits 902, one adder circuit 43 is connected. 
[0198] 

Here, as mentioned above, the data with which horizontal interpolation processing was 
made by the data-interpolation count section 26 are written in an image memory 602, 
and since vertical interpolation processing is performed to the data acquired from the 
image memory 602 by coincidence by the data acquisition section 29, drawing 
distortion amendment is performed, without producing the frame delay as the 
processing latency time. 
[0199] 

Actuation of the image memory 602 shown below at drawing 25 , the data acquisition 
section 29, and the data-interpolation count section 31 is explained in detail. First, 
these data are distributed and stored in five memory from the A memory 71 to the E 
memory 75 by the selector 67 controlled by the control section 80 although the data 
with which horizontal interpolation processing was made are supplied to a selector 67 
one by one from the data-interpolation count section 26. 
[0200] 

And the data stored in the A memory 71 are supplied to a selector 91 through the A 
buffer 81, and the data stored in the B memory 72 are supplied to a selector 92 
through the B buffer 82. Similarly the data stored in the C memory 73 are supplied to 
a selector 93 through the C buffer 83, the data stored in the D memory 74 are 
supplied to a selector 94 through the D buffer 84, and the data stored in the E memory 
75 are supplied to a selector 95 through the E buffer 85. 
[0201] 

Here, each selectors 91-95 contained in the cycle-sharing section 560 divide the data 
read from the A buffer 81 to the E buffer 85 for example, per 2 pixels according to 
control by the control section 80, and supply the data for 1 pixel to selectors 96-99 
for every cycle. 
[0202] 

And each selectors 96-99 output alternatively the data supplied from selectors 91-95 
to a register 901 by control by the control section 80. Four data which are the number 



of taps required for vertical interpolation processing will be alternatively supplied to 

the data-interpolation count section 31 from this. 

[0203] 

furthermore, in each multiplication circuit 902, a product takes each data stored in the 
register 901 between the interpolation coefficient C 0 - C3 — having — this — by 
adding four products in an adder circuit 43, a vertical interpolation operation is 
performed and the output data buffer 32 is supplied. 
[0204] 

Here, actuation of the image processing system 2 concerning the gestalt of operation 
of this invention is explained, referring to drawing 26 . In addition, the image data for 
one frame is shown in drawing 26 (a) - (d). 
[0205] 

If image data is inputted into the signal-processing section 10 from time of day T1 as 
first shown in drawing 26 (a), horizontal interpolation processing will be performed by 
the 1 level-dimensional interpolation section 501 from time of day T2. And as shown in 
drawin S 26 (c) ' the ima S e with which horizontal interpolation processing was 
performed is written in the E memory 75 one by one from the A memory 71 contained 
in the image memory 602 after time of day T2. Here, for example, in an odd number 
cycle, the data for perpendicular processing are read from an image memory 602 to 
the data acquisition section 29, and distortion amendment processing by the 
two-cycle period is performed by writing the data with which level processing was 
made from the data-interpolation count section 26 in the even number cycle in an 
image memory 602. 
[0206] 

At this time, as shown in drawing 27 , sequential execution of the interpolation 
operation in perpendicularly [ of time-of-day T3 to each Rhine ] the data Dmx for 
several Rhine minutes according to the amount of the maximum distortion of the 
perpendicular direction in the maximum distortion curve 104 of level Rhine in an image 
102 were stored in the image memory 602 is carried out. Therefore, since the time 
delay in this interpolation operation is carried out to from time of day T1 to 
time-of-day T3 and it is not necessary to make into the latency time time amount 
(frame delay) to which interpolation processing horizontal to the data for one frame is 
performed, drawing distortion amendment can be performed on real time 
[0207] 

Moreover, an image memory 602 has the number which added the number of Rhine 
and the number for perpendicular processing of taps (for example, four taps) 
corresponding to the above-mentioned amount of the maximum distortion in the 
perpendicular direction, and the memory space which memorizes the data for several 
horizontal pixel minutes of the image which set horizontally and was inputted into the 
signal-processing section 10 as a whole. In addition, five memory from the A memory 



71 shown in drawing 25 to the E memory 75 is made for example, into this capacity, 

and the port width of each memory is made into 32 bits. 

[0208] 

The method of storing the data in field 102P of an image 102 in an image memory 602 
here is shown in drawing 28 . In addition, in drawing 28 , "A" to "E" means "A 
memory" 71 to "E memory" 75 shown in drawing 25 , respectively. Moreover, when 
the port width of each memory consists of 16 bits in which the data for 1 pixel include 
a Y signal (brightness information) and C signal (color difference information) by 32 
bits as mentioned above, a selector 67 carries out sequential storing of these data 
from the A memory 71 to the E memory 75 by making the data for 2 pixels into a unit. 
[0209] 

That is, as shown in drawing 28 , a selector 67 stores the data to the 0 of 0th line to 
23rd pixel in the A memory 71 first, and then stores the data to the 0 of 1st line to 
23rd pixel in the B memory 72. Moreover, similarly, a selector 67 stores the data to 
the 0 of 2nd line to 23rd pixel in the C memory 73, stores the data to the 0 of 3rd line 
to 23rd pixel in the D memory 74, and stores the data to the 0 of 4th line to 23rd pixel 
in the E memory 75. In addition, a selector 67 stores the data of each Rhine in the E 
memory 75 from the A memory 71 one by one for every Rhine like the following. 
[0210] 

the following — setting — the data acquisition section 29 — the number of 
perpendicular taps — 1 — why many numbers of buffers are needed is explained. 
When the image 102 with distortion is seen locally, as shown in the patterns 1-3 of 
drawing 29 (a) - (c), 2 pixels or more of image data are not moving perpendicularly in 2 
pixels which adjoins horizontally. 
[0211] 

That is, this image data does not move perpendicularly above by 2 pixels between the 
pixels which adjoin horizontally as it is shown in drawing 30 (a) and drawing 30 (b), 
although it moves perpendicularly by 1 pixel as this image data does not move 
perpendicularly at all between the pixels which adjoin horizontally as shown in the 
pattern 1 of drawing 29 (a) or it is shown in the pattern 2 of drawing 29 (b) and drawing 
29 (c), or a pattern 3. 
[0212] 

Here, in this perpendicular 4 tap processing, filtering processing is performed using 
4-pixel data including three circumference pixels Ip which adjoin perpendicularly to 
the main pixel Ic as shown in drawing 31 . 
[0213] 

At this time, as shown in drawing 32 , five memory of the A memory 71 to the E 
memory 75 contained in the image memory 602 has a 32-bit port held, respectively, 
for example, and the 2-pixel partial output of the 16-bit image data is carried out by 
one access through this each port in this case. 



[0214] 

That is, the image data IcO and Id which the image data IbO and Ib1 which the image 
data IaO and Ia1 which consists of A memory 71 from 16 bits respectively by one 
access as shown in drawing 32 is read per 2 pixels, and consists of B memory 72 from 
16 bits respectively is read per 2 pixels, and consists of C memory 73 from 16 bits 
respectively is read per 2 pixels. Moreover, similarly, the image data IdO and Id1 which 
consists of 16 bits respectively is read from the D memory 74 per 2 pixels, and the 
image data IeO and Ie1 which consists of 16 bits respectively is read from the E 
memory 75 per 2 pixels. 
[0215] 

Thus, even if it is any from the pattern 1 with which change between contiguity pixels 
is shown in drawing 29 (c) from drawing 29 (a) when only 1 reads many image data for 
adjoining 2 pixels perpendicularly from the number of taps to a pattern 3, the same 
processing is performed in each train. That is, as shown, for example in the slash 
section of drawing 32 , the 2-pixel image data which adjoins horizontally is generated, 
respectively by performing filtering processing for the image data in four pixels 
perpendicularly located in a line in each train from the pixel on one of the main pixels 
Ic to the pixel under two. 
[0216] 

In addition, it is beforehand identified by the control section 80 before this filtering 
processing which [ of a pattern 1 to the pattern 3 with which this change between 
contiguity pixels was shown in drawing 29 (c) from drawing 29 (a) ] is hit 
[0217] 

When a control section 80 receives the y-coordinate of two main pixels Ic in two 
trains which adjoin horizontally from the image-distortion-correction parameter 
decoder 34 and more specifically controls selectors 96-99 according to the difference 
of this y-coordinate, the image data shown in the slash section of drawing 32 is 
alternatively supplied to the data-interpolation count section 31 as an object of 
filtering processing. 
[0218] 

In addition, although filtering processing of four taps was explained as an example in 
the above, it cannot be overemphasized by the image-processing approach 
concerning the gestalt of operation of this invention considering an image memory 602, 
the data acquisition section 29, and the data-interpolation count section 31 as the 
configuration according to the number of taps, and changing the i/o cycling of the 
data to an image memory 602 that it is applicable also to the filtering processing of 
those other than 4 taps. 
[0219] 

As mentioned above, according to the image processing system concerning the 
gestalt of operation of this invention, a configuration with the distortion amendment 



horizontally, simple since a 1 -dimensional interpolation operation is performed 
perpendicularly and an amendment vector is used efficiently to the dynamic image 
which needs not only a static image but a real-time operation realizes to the image 
accompanied by the picturized optical strain, and a high definition image without 
distortion can be obtained easily. 
[0220] 

Moreover, according to the image processing system concerning the gestalt of 
operation of this invention, since signal processing can amend distortion of an image 
on real time, the degree of freedom of a lens design can be raised and miniaturization 
of a lens and low cost-ization of a lens can be realized easily 
[0221] 

[Effect of the Invention] 

According to the image processing system, image processing system, and the 
image-processing approach concerning this invention, since distortion of a 
subject-copy image can be amended on real time by low cost, a quality image can be 
obtained easily. 

[Brief Description of the Drawings] 

[Drawing 1] It is the block diagram showing the configuration of the image processing 
system concerning the gestalt of operation of this invention. 

[Drawing 2] It is the block diagram showing the configuration of the signal-processing 
section shown in drawing 1 . 

[Drawing 3] It is drawing explaining the outline of the 1 -dimensional interpolation 
operation performed by the signal-processing section shown in drawing 2 . 
[Drawing 4] It is drawing showing the configuration of the level processing circuit 
included in the data-interpolation count section shown in drawing 2 . 
[Drawing 5] It is the first flow chart which shows the actuation of the 1 
level-dimensional interpolation section shown in drawing 2 . 

[Drawing 6] It is the second flow chart which shows the actuation of the 1 
level-dimensional interpolation section shown in drawing 2 . 

[Drawing 7] It is drawing explaining the actuation shown in drawing 5 and drawing 6 . 
[Drawing 8] It is drawing showing an example of double conversion — it can set to 
1 -dimensional horizontal interpolation. 

[Drawing 9] It is the timing chart showing the timing of double conversion, such as 
having been shown in drawing 8 , of operation. 

[Drawing 10] It is drawing showing an example of the level expansion conversion in 
1 -dimensional horizontal interpolation. 

[Drawing 11] It is the timing chart showing the timing of the level expansion 
conversion shown in drawing 10 of operation. 

[Drawing 12] It is the first flow chart which shows the actuation of the 1 -dimensional 
perpendicular interpolation section shown in drawing 2 . 



[Drawing 13] It is the second flow chart which shows the actuation of the 
1 -dimensional perpendicular interpolation section shown in drawing 2 . 
[Drawing 141 It is drawing explaining the actuation shown in drawing 12 and drawing 
13 . 

[Drawing 15] It is drawing showing an example of the perpendicular expansion 
conversion in 1 -dimensional perpendicular interpolation. 

[Drawing 16] It is the flow chart which shows the outline of actuation of the 
pre-treatment equipment shown in drawing 1 , and an amendment parameter decoder. 
[Drawing 17] It is the block diagram showing the configuration of the amendment 
parameter encoder shown in drawing 1 . 

[Drawing 18] It is drawing explaining the outline of the actuation of the grid division 
section shown in drawing 1 7 . 

[Drawing 19] It is the first flow chart which shows the approach of the optimal division. 
[Drawing 20] It is the second flow chart which shows the approach of the optimal 
division. 

[Drawing 21] It is drawing 1 explaining the actuation shown in drawing 19 and drawi ng 
20 . 

[Drawing 22] It is drawing 2 explaining the actuation shown in drawing 1 9 and drawi ng 
20 . 

[Drawing 23] It is the block diagram showing the configuration of the 
image-distortion-correction parameter decoder for x directions shown in drawing 2 . 
[Drawing 24] It is drawing explaining the actuation of an amendment parameter 
decoder shown in drawing 23 . 

[Drawing 25] It is drawing showing the configuration of the image memory shown in 
drawing 2 , the data acquisition section, and the data-interpolation count section. 
[Drawing 26] It is the timing chart showing the timing of 1 -dimensional horizontal 
interpolation processing and 1 -dimensional perpendicular interpolation processing. 
[Drawing 27] It is drawing explaining memory space required in order to perform 
1 -dimensional horizontal interpolation and 1 -dimensional perpendicular interpolation. 
[Drawing 28] It is drawing explaining the data storage approach to the image memory 
shown in drawing 25. 

[Drawing 29] It is drawing showing the change pattern which the perpendicular 
direction in a contiguity pixel can take. 

[Drawing 30] It is drawing showing the change pattern with which the perpendicular 
direction in a contiguity pixel is not possible. 

[Drawing 31] It is drawing explaining perpendicular 4 tap processing. 

[Drawing 32] It is drawing explaining the data read-out approach from the image 

memory shown in drawing 25. 

[Drawing 33] It is the block diagram showing the configuration of the image processing 
system in the former. 



[Drawing 34] It is the flow chart which shows the outline of actuation of the image 
processing system shown in drawing 33. 

[Drawing 35] It is the block diagram showing the configuration of the signal-processing 
section shown in drawing 33. 

[Drawing 36] It is drawing showing the principle of the image transformation by 
two-dimensional interpolation. 

[Drawing 37] It is the block diagram showing the configuration of the 
data-interpolation count section shown in drawing 35. 
[Description of Notations] 

2,100 An image processing system and 3 A pre-treatment equipment and 5 
Amendment parameter encoder, 6 The amendment parameter derivation section and 
7,600,601,602 Image memory, 8,700 A control microcomputer and 9 An amendment 
parameter decoder and 10,500 Signal-processing section, 1 1 The grid division section 
and 12 A parameter compression zone and 21,570 The data write-in section, 22 27 23 
An operation control section and 28,520 A interpolation phase and the input data 
coordinate count section, 24 29,530 25 The data acquisition section and 30,540 
Interpolation multiplier generation section, 26 31,550 The data-interpolation count 
section and 32,560 Output data buffer, 33 34 An image-distortion-correction 
parameter decoder and 40 42 A level processing circuit and 43,903,904 Adder circuit, 
61 A distortion parameter buffer and 62 The grid decision section and 63 
Normalization section, 64 A function transducer and 65 The flat-surface interpolation 
section, and 67, 91-98 Selector, 71 A memory, 72 B memory, 73 C memory, 74 D 
memory, 75 E memory and 80 A control section, 81 A buffer, 82 B buffer, 83 C buffer, 
84 D buffer, 85 E buffer, and 200 Lens, 300 An image sensor and 400 The 
data-conversion section and 501 1 -dimensional horizontal interpolation section, The 
1 -dimensional 502 perpendicular interpolation section and 510 A timing control 
section and 800 Synchronizing signal generation section, 900 The Rhine memory and 
901 A register and 902 A multiplication circuit and 905 A division circuit and 1010 An 
amendment data table and 1100 The Records Department and 1200 The playback 
section and 1300 The display system processing section and 1400 Media. 
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HuHB^^^fiJlc &<omz> tifcm^gjcxstf MIB7j<^FffiiE/ ^ ^ — ^ ^iSlR w \c&m L T 
BuIBzM^n- F^I£-MM&« fc^fc, tufB+S^^*3^^»HufBSB:MlE7^^-^^ 
Mi^k-Hli LtlulBiifn- F^IW^lT HfS^IS i: ^-g-tfffsfcjg 9 

fufBTk^p-T^— F3M3W:, 

MaB^^«iJ#l5tJ:D^^nfc^^^bT^Mf^C>a-H^^^Ht?*S^^?* 

^TmE£.rfm&<D&mm& t *s s mi B7j<¥ffi 1E7 ^7<-^^iai-rs 7k^7 ^ ^ ^ 

MlBSiS^n— F^ISti. 
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— ^wm^mt^mn^m 1 o icnzim<Dmmmm^^i± 0 
im>Rm i 2 ] 

tutEMffilE^iS^ 

^ ^iiiiE-r ^ m— <d x -r- >y f t , 

msb^— cd x t- <y 7ic *3 1 > xm z> n mm ^ *r u m mfWM m^m^-t zmmmasifz 
immmi 5] 

[,!i'/d<JTi 1 6 ] 

tufBm— CD x "T" >y X'tc fett £ ffiJElc «fc 0 ?# S tl/£7j<^ffiIEHft^IB'[S^|g^ aB'IS ?«7 
7^y (CM*.. 
tufB^— cOX-r" % y yti, 

ftuf Statt^©^ £> M bBSM IE7 ^ ^ — £ C 7c ffiSBsk^ilEM^Btff-r S -r 1 '— # 
BBj&E 1 7 ] 

Ml a*&^ ^fu ^ «k d f# s n * ^ *3 if 5 7J<to ^sn:^ ft oMiEM^ig^^jtc^ 

F$nfctaIB7K^7aftS.U-'M^-fn]OMlEM^7 ::, =i— F-r^^HcDX^-y , 
_^- =I _ F$n/cfuSB7]< i p75'[B]OliIEM^jSDT, tulBH®fa07j<^p73 ^tot^T 1 ^juM 
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mmn&MT mmco x ^ <y x t „ 

mmn&MTms.(D^ f-^yt. zzt ttwm t~?z> mmmmysm. 
[it Mm. i 8 ] 

J^-T t§f«Xf >y y £ , 
[8S2RIPU 9] 

MfB/^^-^mx^yXHcfet^T^ fct,- ocDtufB^«=^n^^ (n 
[0 0 0 1] 

[0 0 0 2] 

[f£*(D4£t5] 

[0 0 0 3] 

HMISI ioo(±, ^X2oo ^Stfisfi? 300, ^—*mm> 4oo ft^&yg 
gpso o. untrue 00. W^n>7oo, Piffifi^gpsoo, iiiE^-* 

-r— l 0 l 0, aBUgP l l 0 0. l 2 0 0. SOT^M^lgP l 3 0 0 i:^r-(l 

X- •So 
[0 0 0 4] 

Ei3 4©7a-^ t -hMLo-3, ±.mmmmmmw. i o o ®ifto«ts* 

^ t5 ° $fXryy*S l U>X2 0 0 SLtfJtfliffg? 3 0 0^LtS?ft l 0 

l L^t5 7tn^I«fef§A*t5. fLT> X:r<y7°S 2 Tiiv ? -^^g|54 0 0 

[0 0 0 5] 

Xr77S 3fc;fci^T, fS-^MgP5 0 OteffllE^— ^-7— 7;H o l Olc^Mi* 

A^^T-rS*^A^¥'JKlfL. *ST L&^£¥[j|0rLfc^i=r^«X:r>y XS l^5 0 
[0 0 0 6] 

[0 0 0 7] 

U>X2 0 Oii^^l 0 l *^©S|fMi^LTjif|li?3 0 0ic^t§ o gfc 
Jift^3 OOBCC D^CMOS-tr>^^>6M$tl, wsnfcwitf^**:^ 

■ v-bT ^ ^tn^oHiii^^tSo s/c. 5=--^^gp4 o oizmmm?3 o o 
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[0 0 0 8] 

*ite, ff^MgP5 0 0^fffiJfU-T^3>7 0 0^e«?^/cDY>Kt{SD T f-^^ 
IJg[$4 0 0tCj;DM$nfc^>>^;Hl)f^M^^[iif^^^ U 6 0 0 ^|fitSo ^LT 
fe^lg|5 5 0 0ttffiiET-^r^^;l/ 1 0 l 0 fc^follEi&^tirzikMMlcttJfoT&ffllE 

^J:oT. 7-*— *^g|g|5 4 0 O^P,ai*^n/tlfi 1 0 2©^*%MiEtS 
[0 0 0 9] 

ff^Mg(3 5 0 Ofcfc^T^jSSnfeiiSflMS^tt, iS^Mgp 1 3 0 O'Mfcte 
^nscttc^DKH**^— ^rjc^^n, 35SWifBi§gP 1 l OO^mci: 
LJ;D^©r-^fVX^^5^^^U%^fV7 1 4 0 0t3B»?n5, * 
fc, ^r^7l 4 0 0 ^ gallon ft ®{i>ff^i, S^gM 2 0 0t«S^ti WiM^. 

im^mTr^mm^ 1 3 0 o^jns c «t ijRssHm-^ t:^$n« 

[0 0 10] 

JWa^&a^u mmm^3 0 0 nf—^wsmA 0 o&tm^yias 1 o^ts D 
[0011] 

53 5 m 3 3 ^^^n/c^Mgp 500 ©M^f/n 7^ht»*« 0 H35fc 

^n5<t9k fa^Mg[35 0 0f£^5>^fjiJ®gP5 1 0 ilMTO+B • A7^-*j^ 
^,ifP^5 2 0, y-^^#g|3 5 3 0. Mf/iI^M^g|3 5 4 0, ^-^ifllW^gP 5 5 0 

[0012] 

^-^«#)A^gp5 7 Oiiv*— *S?«|gP4 0 0^S«,m$tlfc^^^^Hfaft^ 
[0 0 13] 

vTwmz^ ^ >^h^- s t ;&^u MUHtetH • xt>7 t -#mxmtti& 520 ta^s 
bJwt&jftr&MiE'** hjv&m v>}s a *nm7*-*T-7j\, 1 0 1 o^wserr 

o 

[0 0 14] 

7— **f#SP5 3 0fci\ i*tBLW^S r^H^^&U 6 0 0 'v^-r S C lc «fc 9 

N o i oA^tBjj^nrcffiiE^^ h^oSEftj^^^ufeMKfflT* 

[0 0 1 5] 

— 7a> MH^^figgP5 4 OS, MiE^-^-r— 0 1 0 ^5«^^n/cffiiE^^ h 

[0 0 1 6] 

ffiWOBU«tefettSIS«^U, 03 6 (b) tt@3 6 Ca) O-gP^MAb^K^^-r 
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[0 0 1 7] 

£ct\ mw3 6 (a) ^^^nrc^a i ^s^a 4 s-e^^en^m^HftTS 

ittl^IMi«t5^a l^S^a 4 3; ^'t^lStSii^ 1 0 2 _h<D A 
1WjSA4$TW 0 ^T, EI36 (a) T«jSA 1 j&^jSA 4f ^WbpV 
2 ^tcM^Ic J; D a l * a 4 ST^r^ai^H^^^n^ 

[0 0 18] 

cCDttxMy^^fel>tftlftl20 (2X2) ^Mfi^-^fflt^Ttf^HftO 

&&0D\mm%:i&m-<rz>mtricii^ m%-i£&A 1 *Ht?4oo*s^K o o, k o 1 , ki 
o, ki iiasif&mm^— ^^ffli^a i <Dmm^~ zm&fe-zn&o j&*3, ^a2 

r-^«*n§„ _hfB40<D+S^K 0 O, KOI, K10, K 1 1 li, | 

lE^r—^y 7;H 0 1 0 frZmijZtircmiEmmici&VX&fe'Ztl&o 

[0 0 1 9] 

KI36 (b) fc/^n«J;3(i:, K^KO 0 t^F^K l Oio^ SiO-'tS^ 

lofiiaftifti/hS/^^-^Px, PyiaDi^n^o lo^, ^ai©@ 

^67 ^^IttJtSl^tffl^^tiS^^K 0 O, KOI, K 1 0, K 1 1 (D&miWcr— 
*<DJt^tttf (Mfffl^SO Cn ( n =l~4) M\ MlE^-^-^-^H 0 1 0*p5#M& 
£*l£_haB*j|}IE^ h/KZ>/b»j£3\ T^^/M^^ — ^ p x , P v Ic £ 0 1&'nLlE 

n§„ 

[0 0 2 0] 

77 5 6 0k.«4*^tl, flff^©^^5y^T'g*^ffl^ 1 3 0 OXti» 1100^ 
[0 0 2 1] 

3 7t,t3^t(±, x&tfy7?^tftlftl4 0l^ (4X4) 1§r3f 1 6 flflj^ £> & « TO 
[0 0 2 2] 

ei 3 7icm-$nz>£5ic m$k<D^-zmmtm^5 5 oiz4-d<d^^^**:v 9 0 0 1 

( n = 0 0~3 3) h?k?:ri^nmm^r2> l 6{0OTOIhI£§9 0 2fc, j&l 6ftKO*KC|n| 
S§9 0 2tcJ;f9^P ) n^^-^^ijP^§ip^lH]g§9 0 4 t *nJ¥[U5&9 0 4lC = t0f#C 

tifc-T*— **R*jrr swings 9 o 5 n*^ts 0 

[0 0 2 3] 

[fgB^*^^ Li^ttS IS®] 
[0 0 2 4] 

M<DmJE-r~t?-7 — 1 o 1 0*^Si:S«o 
[0 0 2 5] 

Sfc, MiEf— ?7H 0 1 OOSMfftt, a-^y?7i-X^BO^(a?) 
fflm-?^=i>7 0 Ote«fct)^ff*nSA^ frJ®Jv^n>7 0 0 ^MIE^-^t— ?VH 0 
1 0 i:<DKtu*3V>T«^:#^:jl^a*^S^^nS^:i6, Miv^ny 7 0 0 »J 
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[0 0 2 6] 
[0 0 2 7] 
[0 0 2 8] 

-f-Zfrtb l H^OHflr-^MtS^tti, g^-tf- hmii l H^o^> F*I<0 4 
i§X& Z> c i: £ & § 0 

[0 0 2 9] 

[0 0 3 0] 
[0 0 3 1 ] 

[0 0 3 2] 

[0 0 3 3] 

k-<fc!K MjE^^ H^M^tc-7 s 3-F$«7 :? 3-F©Jffli^^$5,^^Sc:i:{c 

[0 0 3 4] 

*$&m<D mm*. m&*n^rcmmm*wiE~?2>wmmmmwx&-ox, immm* 

[0 0 3 5] 
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Co 0 3 6] 
[0 0 3 7] 

[0 0 3 8] 
[0 0 3 9] 

C TMRB^R^r^fig-r SIS— Ml*a^l&3£/£#jia i: , 35— t*— ^3?f#^©te «fc 0 

[0 0 4 0] 

[0 0 4 1 ] 
[0 0 4 2] 

[0 0 4 3] 
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[0 0 4 4] 

^tR^P^'xi— F^ISi:. Tk^piP'ra — K^gWcj; Di^n — F^n^K^ffllE/^^ — #£rffl 

>{-^^r3^Ft5 Mifiv* 3 - F £ . /K^ffilE^IS \c J; § ffilE icjzomztlfc mm 
MtfU fiifi-rn— F^IStcj; O-T^'n— FJn/ciitffiiE/^^- Z&m^fc 1 ^jcMfS 

[0 0 4 5] 
[0 0 4 6] 

mie/ ^ * — * ^iiiRetJtcjEEiis l ts ifi^n — f ^iw^t- § ^ ^ * — * sM^m. t & 

[0 0 4 7] 

[0 0 4 8] 
[0 0 4 9] 

mf£~? 5 K *5 £ 7j< 1 P75"fn] ©MiEfii&^-r Tfc^PM IE/ ^ ^ — * J&ffl t > -CMMmc M 

[0 0 5 0] 
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[0 0 5 1 ] 
[0 0 5 2] 

formic jzomznrcfe^&icistf zyk^jjfaj&zfmwjjfacDMmm&mfcmc^n 

[0 0 5 3] 
[0 0 5 4] 

felt § TkTO l^&r/M^-^cDffiiEa^ Iffit 5 /^^-^g^^,^^ 
[0 0 5 5] 
[0 0 5 6] 

[0 0 5 7] 

mm^m 3 st>*^ rv/i 400 mmmmmm 21^^x200 tmmm^ 3 0 
-^v-n-^9 N Rmate^jERas8 0 0, lEiigpi 1 00, mspi 200, &.Tsm.7jm 

[0 0 5 8] 

C C T\ U>X2 0 0 1 0 1 ^eOfi^^i^LTHfl^ 3 0 0 t^ts 

/c, iM?3 0 OttC CD^CMOSt^^6«fitt$tl, IrUW<I^/j£3I5 8 0 0 

e> $ n ^ ^ gp iwjmb tc *s u t , ^jn/c ^ t ^ t - L7tn vmmm 



(12) 



¥f fm 2004 — 80545 



[0 0 5 9] 

f*-*sijtau o oti«H»jts^3 o o^^M^ti. mmm^!ki£t$8 o oa^^^n*: 
Mim^ic^mvmmi o 2;&3£^« 0 

[0 0 6 0] 

1 0«, KMJEfc =fc Dlt^tlfcSftfg^^^MgP 1 3 0 ORCffBtSSP^l 
[0 0 6 1 ] 

fiflES^* h;l^j±!S (^>n-H) U ^/±ffi^-^p 
[0 0 6 2] 

MlE/^^-^#tbgP6tcfe^^^^^_hia^>n-F«. 
[0 0 6 3] 

[0 0 6 4] 

iE/^^-^^a-^9-\#t|&r§o 
[0 0 6 5] 

MIE/ ;* - * 5*3— *f 9 MiE/ ^ * - * oc> n - if 5 £ #j» xM- 3 > 8 

^nrcit^ic/s ut, ffljE/w — * i > n — ^ 5 e n/toc > h-fj nr^s. 

M7-*~2P_c&&mmicMfcLrcMjEm;^*~$W$m (5*3- F) L, SSMlEa^v 

^ — ^ ^{H^&LJIgP 1 0 ^mi&t 0 
[0 0 6 6] 

[0 0 6 7] 

s^c, tasigm 1 0 o i±m^mm^ 1 ocgun, ft^ngpi oiciOMJtifd 

mim^*-? — ^^U^^tVx^ DVD (5*S^;l^ffl^Vx^) % /n — Ft 

^^'Jft^rVr (ih^^) 1 4oo«t§o j&fe, «#fiaagpi 0 
0 otciait$n^j:d^-r^,o t &-e#£ 0 

[0 0 6 8] 

£/c> fSifcgM 2 0 Ote^Vr 1 4 0 Olcmm^tl, ^t>71 4 0 OlCfeMZtlfcm 

imm^n^^-cm^mm^ 1 3 0 o^MtSo a^sangp 1 3 0 oafg^agp 
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i o&zfn^i 2 ooicmmzti, m^mmmi oxas^i 2 0 ofrzwt&ztM: 
MMim^&^e—izicmT^T&o 

[0 0 6 9] 

fe^^u mmm^3 0 0 ^^-^^ gM 0 osmi^wi o^ts. 

[0 0 7 0] 

<fc 5 fe-^Mgp 1 0 «7j<^ 1 ^tcMKSP 50itifii ^ttMHSP 5 0 2 

It^tU 7(i7K¥fflIfflF I FO^tU^P.ftSB^tg 6 0 1 £MlS#LJlffl 
7^>^777^%5Bi^€U 6 0 2 MlE^^-^irri-^g^xTafp] 
ffl«H2ffiiE/^^-^T3-^3 3 i: y^fafflcDMMiE^^-^rj-^3 4 ^ 

[0 0 7 1 ] 
[0 0 7 2] 

?i3> 7J< ^ 1 ^c»ra^5 0 1 tt-ir-**#i&*a$2 1 £$ftftlttI3|S2 2, MRBttffl • 
?!f 2 6 M 1 ^TCMMSP 5 0 2 «^$ij®gp 2 7 fcffilHffiffl • A^T*-*^*? 

-7 ^^7 7?3 25tifo 

[0 0 7 3] 

*MP2 3 £.wm**:V 6 0 1 RtfpfiEffiiE/1^^-^v*3-^3 3 

#fffl«»^fiJtai52 5ii®^MiE/^X-^^a-^3 3teSBR*tU 7*- 2 

6 ii-7--^TO^ 2 4 soti^^^ 2 5 icmmzti% a 

[0 0 7 4] 

J*,,?*^*-. 60 l«^-*#*a**W2 l&tf^-*««9«2 4k:aBtt*tU Mtt 
6 0 2ttr-^Wftl^2 6M'f-^W2 9 tiiJn^o Site. MMM 

[0 0 7 5] 

^r-^77?3 2iiT-»w3 i&vmmm^mms ootgi^s 

o 

[0 0 7 6] 

S^55r~Ji" ,y:7r 3 2 ^?^-^«^M^l 3 0 0MfEiSPl 1 00 

bp 2 o t<-3s#ca n§„ 

[0 0 7 7] 

-t«2©£? 1 0 T?tt % SfTkT 1 *7GMIHK* 5 0 1 
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f^) <d i ^7v.mmmm^mn-r^ 0 {m^mspi oteis&aijitflDM*, m3 

?:#IbOO^t§ 0 0 3tfeV>T(i, x^O : y77f6]^^-n^n4oMA,r£ (4 

X4) ^if 1 6fS*^^:§Ilift^— ^^ffl^Tm^l®{ao#^OilJf^^— ^«?ti5 

[0 0 7 8] 

^LT, El 3 (a) «x^fB]CDMlEtCj:t), ^^ff^JIIiMM-rS^B 1 ~B 4 t 
^fSLT^fMB 1 0~B 4 0Oiif|r-^A^$n/cCt^U EI 3 (b) « 
^^y^facoMlOC^D, j&B 1 0~B 4 OlCfcfoSLT^b 1 ~b 4<Diif- ^'HE 

[0 0 7 9] 

^©IWMSItCttiD^B 1 0CDHJ{^^— ^^©m^n, IBJ^C^B 2~B 4 (C 

^iSLr^-n^n^B 2 o~b 4 cxDmm^'— ^t>mta^ri^> a 

[0 0 8 0] 

^tc. m3 (b) tc^nsj;^;:, 0u*.«j£b 3 oic*fLTii. mmyj^cmmi^rc^ 

B 3 0^<-«irt©4OOM 0&K20-K23) KfettSH^-^mjEOM 
R8i«ir*fl6rrc:fcfc:<fc9^b 3 ©M^— *#}?ffisn5o ^bio, B2 

0, B4 0(cMLTWtl*b 1, b2, b 4 <Dm\%^r~ ^^ItBJnS, 
[0 0 8 1 ] 

nsKi4 ^7K$nrc7j<™iitHi£S4 otcj; smmtstiZo i4c^n-sj:at7Mi 

Mi&4 0fcj\ 7^^t'J 9 0 0t, ^^t'J 9 0 0<DtB£lS— F {cm.&lt8Bt£ tilt 

4ocd^x^9 o i ^u^x^g o lfrzmtiznrcT-ziiMmTzffimmmc 

Hk (k = 0~3) t^UgfS 4O03||J¥lslK9 0 2 4 0©t«9 0 2(^*3 
[0 0 8 2] 

[0 0 8 3] 

&2icmt£tittm*§9BEmi o<DWirp<Dmm&t$imtz> 0 jff-^«4oo 
*^7k^F 1 ^.Tc.mm^5 o 1 ^A^^nrcHfls-r— ^— ^»#iA^g[3 2 iuot 

^^E'J 6 0 1 tttjAftl^o 
[0 0 8 4] 

cottar- $m'm$2 4teffifrmLfomm^&7Hs?ts!mm<Dwmx'ev 6 0 1^033 

[0 0 8 5] 
[0 0 8 6] 

SSl^»gP5 0 2m r - ^ ffifgp 2 9 B^IE;^ ^ - ^ f n - ^ 3 
4fr6{B*&£*l5 yTafafflcDffllEM/^^ — * YmtfSCt, StMfflOBI^ty 6 
0 2^e^tE^fn]t<iM^:®fa^— ^ffifSffliF— * £ LTMt5 0 f br, f-^ffiffl 

[0 0 8 7] 

&*5, _kSBcDJ; 5 fc N 7j<¥ l ZKfcfflMffl 5 0 l RUmm 1 ^ttMHSP 5 0 2 jc «fc DUff ^ 
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[0 0 8 8] 

SUISSE $tlTl^ ^cO|SlS]g§>grJif2^^4±fflLTfemi/^ 
[0 0 8 9] 

— ^sssiau o o^^tB^^nsBtf- ^«Mi^7tMP^si5 5 o 2^$n, mm 
i ^TrMP^M^sg^n/i^^— H./i<^5aiifflcD[ii{a^^u 6 o i A««?n5„ f lt 
. coilzoizmmx^V 6 o i fcJftWStifeHfflfc-r*-- ^^ic?k^ i ^7cM^gP5 o 
1 ^ J: t>7j<^ 1 3fc7cttrajWJ¥#Bfisn, ^^^ffilE^nrff ^Mg|3 1 0 

[0 0 9 0] 

^/t, _LfEtc43^§^^MiI^ 1 mtiftcD'r— ZlcmmTZ>(DZ>.%:£>'?\ fefa-^- (RGB, 
YUV) (c^bt^«tlfflbtfe^i\ SStc, »JBf*^^bT^iP B ^^^M^±l 
i=> &c (i, <|t:ii'i:MKJH,^; ( c MJ9J LT^^^tf -Tti^mv^ 
[0 0 9 1 ] 

^K)-r«o_ -r&fria, —mmc \^(o^^^u>X2 o o^mmT^tmmicmm^ 
#^ix -7-u(D^^\yi/X2 o o-hmm^z tmimc&m^'Voi^&m^T & 0 

[0 0 9 2] 
[0 0 9 3] 

M-^WtCfi, frljlE/^^ — ^^=f — ^9(if)iiJ^-rr3>8^5. l/yX2 0 0 OfutiS^TjCT 
[0 0 9 4] 

ckdj;?^ mnc^^n/-cisi#Ma^K2^j;n«\ u>X2 0 ocD#i4^if]f-s £ 
■5 &±ai^<- fe^r , wmmc m Dtfn- f jti/cffiiEi^^ ^ - ^ co^^iframc 

[0 0 9 5] 

[0 0 9 6] 
[0 0 9 7] 
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[0 0 9 8] 
[0 0 9 9] 

ffii^7^ — * -^n— 9 Tb^iff u >x 2 o omcj&vcmiRmcm&ffiT* 

[0 1 0 0] 

snsrtaupiwte^tcjtsiiTfww^-r^^yM^^fig-rSo fir, ffiraffifa • at^ 

[0101] 

Hfamcl^ Xr77Sl(ca^TWfffl-A^T-^S||||-M2 3^ 07 (a) 

i^^ft&£5i<-m&wm-gtimg^Wk-£fLrzmi$i±cDmm(x, y ) tit gjotm, 

/■;t«cioi±oii (Sx, s y ) ttVWU&tAlC MMIE^J* — *f 3 3 
^»iE^7^-irg*fef R x*«tt&tS„ ^>7S 2fc*^T, MffiuE^ 

3 tlfeMlE; ^ * - * ^RUiJ- R x &&&&& ( S x , S y ) 

[0 10 2] 

C C "^iWsBMiE/^^^ — ^"7*3— ^3 3 fi, mifROM (Read Only Mem 
[0 10 3] 

X^-y^S 3tC*3l^-C\ -t*— *UJtf#gP2 4 ^ffi^fiffi - Atlr— &mM9tmffl 2 3 
J & * ( X . Y ) IC . ^^-^rn-^3 3^5^j n/i M IE 

S^W^ — ^Xm^jSb/cffilEfi^^ (Xm, 0) &tmXZ> 0 cniD> EI 7 (b) 
L^$nSJ:5L, SIEhu©M«0 I tc*si/^T±IBffi*R (X, Y) icwm-f&j&cDmm 

(X + Xm, Y) % T&fr-ZffijE^l? hJVtfj&tblbfLrcZ £IC%:Z> 0 

[0 10 4] 

[0 1 0 5] 

{* x -r- -y 7° S 6 t? 0 
[0 1 0 6] 

1^c{4Xt7 7*S 7^\jlt? 0 — ^ Xf-y^S 6T(i, H§X€U 6 0 ltff-^«H 
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[0 1 0 7] 

±SB»C*5l,<>T\ 7*— *8tf#SB2 4 lt^tilf£tlftmJE^ bAXDxf&ft (X + Xm) OlS 
[0 l 0 8] 
[0 l o 9] 

[OllO] 
[0111] 

— 7?. *flHI«»£j*6P 2 5 tt\ BSffliE^7^-^f3-ir3 3*5«|&?nS«iEl/< 
tt«*4Jirr«, **3 X :©J;5Wi, ft ^fMiSgp l o &cA2f£ns@MSi l 0 2^r 

GB7t_Y7h <wa-K:aw3 $ ns „ -7?, Yuv7*--? 7 h y^/Mar^ y 

frf yCb/CrtCO^m MlHi.iy ^^-^XmcD/J ^tftft f£ & < fe {# ffl 

[0 112] 

teJARUffl-T— * J:ffiffiHI««fcfc:jStt-c 1 ^7cMKIiaW«r^fT U Xir <y 7°S 9 

o 

[0 113] 

_kfB© 1 ^7C«fffli»Hfz?« % m(fYUV7t-Y7hf;:fcvm EI 7 (c) 
fc^tlS«J:3te*eiE^^h^ (X + Xm, Y) <tt&frC>AWl5\fote&\,>T am&(ow 

[0 114] 

— 7a\ Xt7 7°S 8^^^-^^#g(5 2 4 tf*f W{£tfB • A^T*— *jffi«tf-*8B2 3tHl 

nzwmms • xts-r— zmmnn^z 3 ^h^mie/^^— ^ 3 3 ^^_^ 

[0 115] 

2B*w±^iiit§^(^ mmwiEs ^ ^ - ^ - ^- 3 3^e»m^^n^MjE»/^ 
* — * - ^ 3 3 (Dmw-tfWit 2 n s o 

[0 116] 



(18) 
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a fct % MiE^C»H^^^^§^^^o/-cMa^cD7j<^73r^tC*3^§S^cDlt^J:0 
[0 117] 

X-r-y^S 9T'(if- ^JffSiHSgB 2 6 7^\ ftSnfcHft^— ^^MMffl^-T >/Vy 
77*>f>^§Bf|^tU 6 0 2^\|§it§ 0 fit, Xr'y^S 1 0 T'^M^fM • 
V— ^MUtHEgR 2 3 tfmm&<D x ffilJf^St 1 Tr%^%m^7j<^HifiEi£H S 

ft(Dmm-r~?t>mm*^v 6 o 2^m^$n;^s7>;&¥<jifru 1 

[0 118] 

Xiry^S 1 1 -e^M^fi+I • A7U^-^^ff^g[5 2 3^xJ^^S x 

ySiu«§o ^lt> xf77s 1 2i?w^sfi • xtj^r'-zmmnmmz 3 
e 0 z^mn^nr^^mmi^ 1 7u-2*#©^-*awjsnfc£^L/-c 

r>y7S 1 3 ^.jltS'o 
[0 119] 

W±«fc 7j<^p 1 ^7rMKgP5 0 1 ^^^J#^fci^®fa^^LT7}<TO^cD 1 ^jcM 

u mznrcmm&mmmmmomm**:! j 6 o 2 Ku^~r^> a 

[0 1 2 0] 

tfefe^tcBU-rssift*^ u ei s ( a ) im^-mmM 1 0 icxtHEnrcmmm^—** d 0 

~D9, (218 (b) 2£tM2|8 (f) «MJE»7^^-^Xm, [218 (c) St>*EI 8 ( d ) 
[0121] 

s i2i 8 ( e ) ttMraffitH • Ajj-r-zmmzmffi 23^5 mmie7^ ^ - ^ 

? 3 3^itM-£ti% xjmm (x t) 121 8 (g) &^-$ m ^ 2 4 lz J: D ^fiSc$ 

n^tiijiE^^ h7KDx^ (mie7^^-^) , ei 8 (h) immmvmmcisif&mw 
m-f~?(D7Y\s^ Eis (i) mnmm^^n^nmTo 

[0 1 2 2] 

0>J*.if, I2J8 tc^^n^ <£ 5 tc, fflIHtOMfa&c;jot^TxJ^tJ§7^2. OcD^tCfiiBt-?.^ 
-^COMlEilt7^^-^X m « 1. 2 5«W 0 ^<D*SH^ MiEHfjC»|Uii^^^^^^ 
©fcfffr&co x 1^2. 0«|IEi/^7<-^Xm^DlLT3. 25«A65>tl£ 

o COfcllxIg (3. 2 5) ©iSt^T) (3) Tb^ilEtuOffl^tC^nt^lg^-^O 

7- f ux^^ o . 25 m§mmB?£^To for, mjEi&commicisifz, x 2 

-***f#ii:U 7)<^ip E g^^7V^cDf4ffi^o. 2 5 L7c l ^TxMHS^tc.fc 
[0 1 2 3] 

121 9 (4, 0 8tC7j^^n7t^fg^^cD»]^^'l'^>^7S^^^^>^ElT-fe^)o llT 

1219 (a) izmnmmm2 2ici&ifezti%\Hf®mmm^&ir^ m9 (b) 

2 2^cfco^fiJc^n^MSu^-f'5v^fs^ Ei9 ( c ) ti^-^fxf#g(5 2 4^p>af^^^ 

u 6 0 1 t^?ns^ttitwi§, gig (d) izmm**rv e 0 1 frz^r-zmm 

gP2 4^?n5Ifflfflf-*, 1219 (e) teMHffcfB • A^^-^^ff^ 2 3 70> 
5ai«IE;^7J-^r3-^3 3^$n5x^8l (x t) ^tl^tl^t a 
[0124] 

sfc. 09 (f) !»MiE/N77;-?f3-^3 3^p»tii7j?n§ffiii^77;-^x 

m^U 219 (g) «^-^TOg[32 4l££03Lf%lEtl&mjEs^?i--Z^ (219 (h) 
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Ffe-^-Sh, 0 9 (1) ^Hfg^^y 6 0 1 Tb^M^ttl^n^ 2 ^-y-7°cD^— ^ i9 ( 

m) ^y— 2mms-tn§$2 Q^^mm.^^^ 6 0 2A^jti§f- 09 ( n ) a^* 
«^0^^rffiiBS{t-r^»fc<!6^, — dot- zttm&rc&btDmsmnicto^^'rte, 19 cd 

[0 1 2 5] 

cr^i^/wcstttesns^ ei 9 ( e ) ic^-2£tiz>£5icffim&m- xti'r-zm 

fief ifEgp 2 3 « 0 . OA^l. 0o'o^>^ij^yhJti5xli (x t) 
IE/ ^ p< — ^ 7 s n — & 3 3 § 0 

[0 12 6] 

cno:^ bj9 (f) ic^n&£5icnmwm'^*~£^n—&3 3&ftifc^-z>MjE 

— -ecD^tC-T 1 — ^mm^2 4 fiEl9 Cg) t^Jtx^ffiiE/^^ 

— &*Wm?Z> 0 El 9 (h) ^^^nScfc^tc, v*-^^ # gp 2 4 iiggfcglE^ 

o ^bT, El 9 ^(c) S.C/E19 (d) £C7^$n-?> J: -5 -r 1 — 2 4 (irgttfb^tl 
fcf^mL$iJMs^£:±±K:, ±9EcD J; a &c4#5S<* n^T K 0 ^eH** y 6 0 l -\#t 

[0 1 2 7] 

cticfco, EI 9 (d) tc^JtiSi^t, nifl^ty 6 o i KUXOt^ffSt 
£ -r — ^DO^S Hlft^M H3ffl t^— ^ ^— ^? 2 4 'Ml^l ttj t} t Z> a 

[0 12 8] 

£te, i9 (g) &tfE|9 (j) (C^^nScfcat, StiT2tfc^tf-^W2 4 
«MiE/^p« — ^OSE«J«^2J^±i@ijpLfci:J|5iJWf"rst, A>f^ (h) 
^fe-^s k^lLTffiP^SH • XtJ'r— *mWR2mz 3 £-7*— *MIBif-#gB2 6&t>* 
MMlE/^*-#^=i-^3 3-v{&*£rr£ 0 MMM, EI9 (e) ^5>E(9 (g) icjjk 

^n&^d^-B^ijT 3^s i ^^^;uop^MiE/^^-^o^ifjf^f-?ih$n^^±t^ 
, EI 9 (m) msm9 (n) \C7r^t\Z> «fc 5 ^tf}7J^-7VWiH#^n -7 L^;McTOtt 
ft£n§£ fck. £^T, t*~ ^MRSlfg:g(32 6:fr£>ilJflM^y 6 o 2 ^(D^r— Zthlim^ 

[0 12 9] 

$te, EI9 (g) &^EI9 (k) (C^$n§J:^^ ^IXf#0P2 4 (iB^ljT 4 ^*3^ 

T^c^nteffiZE/W^-;* (8. 7 5) ©lli^^ 1 V--r*7l>M<DmiEs^*-* ( 
8. 2 5) <D&&l%ft£mVT*&%ilWMl^ m%l T 4 ^fel^T*-^ HOT S h ^/ W 
U^/Mcfg'£ffc2-ttr£ 0 cni^ EI 9 (1) *c^<*ns«fc-3fc:B#£iJT slcfci^T, ir- 
^lf^#g(3 2 4 (ijljft^^y 6 0 lfrZMV-^lrjVtl5]V2?>y7°CDmmm^—$D8 D 
9Wt5o 
[0 13 0] 

&*5^ ei i o ^Ei 8 ^n^^jop i ^tcmhjc «k z>m*%zm<Dmi*mtt7rs u hi i itm 
9 tttmi^mttwzmcDmftz^ ^>??t7jk~? 0 c o^^o^m^ eiio ( e ) ^ 

ZHa&O. 5 £ LTTk^^ifijtc^^n^o EI 1 0 (b) fiir— *#W0*^ 

£> 9* T?cD 1 O{0^^-^^O^T^MlE«/^^-^Xm^^L, EI 1 0 (f) «^ 
^.tSIte -T^^-^ xli^2. 070^6. 5STti5^§0. 5P^PicD 1 Of@cD 
^ is It MIE»/ ^ -5- ^ — ^ X m &7^-T 0 
[0131] 

^LT, Z<D£o&ifc*:^mc25^-Cl£^ Ml 1 (g) tC^^nS=fc5tC^jT 2, T3 

, T4, T5, 7 6iz&i^TmiEs^*—$cDmm.f%fttfm{t^tei^rc& s &mmiz33i^ 
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[0 13 2] 

Eli 2Mil 307n-ft-h^iLoo 1 0 2 t^tifcijt l 
[0 13 3] 

ift6 ? lci ^ X^v^S Hcfe^TffiP^lg. A^7=--^^^»g|5 2 EI 1 4 ( a 

) J«-^*nSJ:-5^^MiE$n^^g|^tl^:iii«±CD^ (x, y) fcLT ^JOffi 

bfcH{tc iotiois (sx, sy) mammal,, mmmiE^^^^^a~^3 

o 

[0 13 4] 

CCTiiiiE/^^-^f3^3 4{i > Mx.fi: R OM (Read Only Mem 
o r y) £rf*jMU iROMIC y i: MlEfi^ * - * YmfcOfflO^fjiaf-^^ 
!^f^i:^?^ a ^ TfeS ^ b > ffilEMv^^-^Ym^yMcDag.^riil^^LT^ 
[0 13 5] 

^6«fft*tife*tti (X, Y) ^ HiBMjE/^>«-^^3-^3 4^6flaft*nfcMiE 
s/N^*-*Ym*C/Si;/cfflIE»^ (0 , Ym) ^P*^ dtlJ:D. Ell 4 (b 
) *BiEM©Mi8i«0 ncfev^T±IB^ (X, Y) tc^fjcs-rs^ojffi 

t« (X, Y + Ym) , t^:t)^miE^^ hjV^M^ti^a CCDt^ ir— * IfXf#g|i 2 9 
(i^/&£nrc*i|jIE^ h;^y^ (Y + Ym) CTllHg!* >J 6 0 2^5 

9 -S>o 

[0 13 6] 
[0137] 

^lt. xf'y^s 4^$3^r{i, iaffliffl^gi^tij 6 o 2mm^^nrc±.mT k 

[HJB3HC+ — ^^#g|3 2 9^\tH77-r§o 
[0 1 3 8] 

- 5£n B ? Ii* 1 "^^^ U * > KMC fcte J: D«r F U^cjSCfcMM 

[0 13 9] 
[0 14 0] 



2004-80545 



im^mmv i o icAJj-ztizmm 1 0 2^RGB7*-Y7ho^:tD^iffl? 
k *3 1 f %> 7-*— # sgjs^iwi c *§^-k: « )?iMs-^ w^;^ am Jt&Mm^- coy^jv^ ms t 

L T *Uffl 77 # , Ht 2 — * SS^S* § i§^- k « MIES' ^ ^ — ^ Y m ©/Jn»j£#7B* 7? 
[0141] 

YUV7*-V7htcfe^m El 14 (c) lc^jn§ ck^kliiE^^ Ml/ (X 
, Y + Ym) 03fif^^SMLi:7j^kfet>TMx^8®^<^)lSJg^— t ^7b s Mr^ffi^— 

[0 1 4 2] 
[0 14 3] 

x t- >y y s 8 t? « , MP^feffl • atj 7*— * jffi^tf- ^gis 2 8*'x mm* S xmtftlC, 

[0 1 4 4] 

-r^^^M-^-rv^ (mh^) ftoimmf— ztfmti^— z>^;~7t 3 2^e> 

[0 14 5] 

BfiuDMA • ttf/J^flsfc*v>fea6, (3 14 (a) k^sn^TOrftcax^-v >k*3^T 
fc#u.«4, mm^^ev 6 o 2tcfcit§^iipjT(cjs£;i;Tt§^fTOfflT-^^^tf}t 

f^P B ^A# < C O J; ^ £:i§^c. i?— ^X?#g|3 2 9 «M H9fufl • ATj^' 

~*&«tH*j8B2 S^H^MiE/^^-^^n-^3 4-\Sttft$n/c^ff^WT^ 

[0 14 6] 

[0 14 7] 

Y + Ym) 
[0 1 4 8] 
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^UT. m 1 5 IC*5U>T. y WO^xffi^O. 0*^10. 0 <D 1 0 fEI^ *JiMiE 

-^Ym^to t*^%Mx.!f, MlEt^afiSKl&^TMf (1. 0, 0) ffl 
IEtu^J^a^^*3t/^TJ^^ (1. 0, 7. 1) CD^lC^fjCSb, fflIEM/^P< — ^^7. 1 
T?M^{utS*^^/J^^O. 1 il^tlSo 
[0 1 4 9] 

— ^ rn — 9 cd Kf^cD ffiS^IBW -T S 0 
[0 15 0] 

1211 6tc^^ns«fc'5 tc. X-r-y^S 1 MiE/^^^ — ^oi^n— ^5 A^ilE/^^^ 

[0 15 1] 

JEM^? hJV^:l±mi^XI±m^— 2 P c ^ bTffilE/^^^ — ^-^'ri — ^'9^\f4tl&-r§ i:±t 
[0152] 

^LT, Xf'yT'S 5 -ptef*— 4 0 0 ^I£*ft{|Hc J: K> SfiScSnftTtd t?Wmim 

*$&7*$?&Jl'm&m*5l£2&&'?%>o Xv^y^S 6T'tt, fililE/ ^^-^t3-^9 fifililE 
1^7^- *<E>^##l3ggfl 1 O-xOM^mbtC^S^^^^b. XT77°S 7&C*5^ 

xm^mmm 1 o^sf^^tifcM^^^^jscriEM^T^o 

[0 15 3] 

-^i>n-^5^P.f±t^^ n /- cIEE |g^_^ P c^f 3 - FL< f#£>tlftfflIE«/^^- 

* j&fH^aaijs i o ^*&-r s „ fit, x-r- >y y s 9 k v m^mmm 1 0 turn 
[0 1 54] 

mi 7 icTjk-gnz&sic mjE^^?<— ^5i^^^-m^ 1 lt;^^-^ 

— *EE&ggBl 2 li*F?$HPjas l 1 £MIE/^* — *#m^6^M^n& 0 WT^fe^T 

o 

[0 15 5] 

s-r, ts^^fijgp 1 1 i±"r— zw®$i>4 0 0 tcj; om^nrcmm 1 0 2 j&^^o^jsic^ 

[0 1 5 6] 
[0 15 7] 
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mm^it-r— &mmg$4 o oic^o nrcmmi o 2o^iito (^) icmux 
^M^n^^Ef^rcub, mis (a) ic^$ns«fc-5 tc N mwn 0201/4©^ m 

[0 1 5 8] 

Jl^i x y ^<D;TO<£>?3F WMte * § c i: k: D ftfKDi^S fe 

CO 1 5 9] 
[0 16 0] 
[0161] 

[0 1 6 2] 

J^Ttcfet^T, ig 1 9^a ; Ei2 own- 7^ — hMLo^ t&^fijgpi ncj;t) 

[0 1 6 3] 

S2T?i£Bll 8 (a) JC7n*nS®®J:4St<: felts 1 ^-f>L 1 <D*fIE»/-^* — 
i:#tcfe^S|^MjEa/^^ — ^Xm (x) Ox^ttO-W0 2 1 (a) t^$n§ 

o 

[0 16 4] 

XryyS3tU GBR & ) <D 2 Mi Jfe&75f fc: * — y y h & & Mfc L , £: ,1S 

^-^y hj^fcOH (— ^fettS^^2^JM^ (OT. 2 ^JitiSj i: 

[0 16 5] 

COi:^. ^K^feV>TMiE»/^^p« — ^Xm (x) cDfit£I£ 2 ^JliSU: J; 0^5. 
[0 16 6] 

o *fe, ii^i^^siaD, i^.(fi2 i (b) t^nftjjsx i , X2, X3^)d 
x<omm£{,T<DffijEm'^*— *x m (x) ^k^jc 2 ^m^-ej&n 

$nSo 

[0 16 7] 
[0 1 6 8] 

X-f-y^s 6 T^i^o}^— ^^r»£p^i: LTI£S^£cd 2 Hifefc7afc:*— ^>y 
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$n/c^X5, X4«^Jtl, x«tbt«I/^^-^Xm (x) tfg 
[0 16 9] 



[0 1 7 0] 

SUfuB (Siig^) ;&*i6£ 0 Cd-eMAtf, 02 l (d) tc^n*«fc3»c. ^X4^fi 
X 1 fc*Jt«"TSc:fcJcJ;0j^X6*i»^U ^X 5 fcjSX 2 H&ttmTZ c £ J; o T 

[0171] 

i:¥'J»rb/c*i^iiX7->y^s 1 1 ^ifgtr^tc, x73|pre&< y 7^ ^WWfUfc 
[0 17 2] 

U_««l*yffi«. «tt*«IE«/^;*-*Xm (y) tLM«0 2 1 (a) irITO 
[0 1 7 3] 

mi ztc^nfe/^^-^jBEwepi tf^Mwasi i^6«aesnft^ L i 

2fci\ 0 2 2 (a) L^$tl^ i 9 5 0 L 2 ^MH^ t LTi*S 

«o £ £ -etflJxfif. eL2OSaOxl®X0WX2hU Ctl6pf4S»C*tt* 

/ 73L2±©ii(c$ 3 ^xll^XK «IEI/^^-^*Xmli:LT 



) *i«fc-r«»c a, 

[0 17 4] 
[2& l ] 



c b, c c 



Ca x XO 2 + Cb x XO + Cc = XmO 
Ca x X1 2 + Cb x X1 + Cc = Xm1 
Ca xx 2 2 + Cb x X2 + Cc = Xm2 



(1) 



fcfcs 02 2 (b) M12 2 (c) JC^<**lSJ:3fc:, XlttX0A^X2S«l 

&M.IEM/W*-*#\ fti^XlMXmlfcLTigSxi: (1) fcttAStlSo 
L 0 1 7 51 

cc?;^^-^gpi 2 (i, IS?5 0^^H^O^T±f?E«Ca, Cb, C 



(25) 
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c^mrnVTUWr^tniC Ltl5«a, Cb, C c ZtWr-Z Pet LTH 

IE/ W P< — 9 -T 2 '3 — ^ 9 -Xfit^-T § o 

[0 17 6] 

1212 3 ii, m2ic7^-gtifcxjj\ti}m(DmmmiEs^*~ &3 3(Dm^^-ryu 

~ M7776 1 ^?»6 2, IE^bgP6 3, M^l£g|gP6 4, ROTSMWgB 6 
5 ;£r-g-t? 0 

[0 17 7] 

— r 6 1 teffjiJpT-f =: > 8 2&miIE^v ^ — ^ai^a — 3f 5 

[0 17 8] 
[0 17 9] 

ie/w^-^^=3-^3 3 nm^m^m^ mmmmiEs^?t~<$?-r=i~^3 3 >iwi 

[0 18 0] 

S-TxE*^^^ — ^^777 6 lit. Wms^?l — Z^>^~&5£9!±m'r—$Pc£ 
[0181] 

*§M^g|5 6 2C2. ff^MgM 0*^MiEm©H«^46S^Ox^ (x t) &tfy 
(y t) *MlE/W*-*g&W¥R x fcfttgiL, iiS^Stl^M*^ 
-TSo CCT% #m*/£f?P6 2(i«^^tlfc^ (xt, yt) £ * - ^ -y ^ 

[0 18 2] ~" " 

^Tt-src46, mm (x t, y t) ^ktos (2) ^^diem^^o <au £<n?« 

02 4 (a) ^Tjs^tlS J; -Mc. (x t, y t) J£^tSlfa=?-W(Dmm<DmWtP (X 0 

. Y0) £ (X0, Y2) . (X2, Y0) fttf (X 2 , Y2) -pftSt^n. 

[0183] 

[15(2] 



px = 



py = 



xt - xo 

X2 - XO 

yt - YO 
Y2- YO 



(2) 



**5. _h!Ex£ (2) ^«_*5ttSl/ (X2-X0) Ml / (Y2-Y0) OfifiteMlE^ 
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6 3 ^fei/>TJiiBM*ffli/^cmi¥*^ff"rsc: tiaoT, ffifl (px, py) T^tti^ 
[0 1 8 4] 

m&M&m 6 4i*. m24 (to ic^-gtiz^sicmm (xt, y t) 

*5^T, xXiiyOlit LT<DfflIE«/^^ — f (x) hi g (x) . m (y) N Rtf 
n (y) ^*^^, 0 3=fcM$C^gSg&6 4 fcfc, JlSS 4 OCDM^cD^n^n^fe^^^ C a 
. Cb. C c {»[f$6C L £ Lt^;^^-^My77 6 1 *^S«t«. 
[0 18 5] 

*LT. BB8fc^g|g|$6 4 ±IB4O0M|gC^rfflV>T_tfBffi^ (x t. y t) (DMlEM^ 

m$kf, g> m, n&M*-i£~Fm<D&. (3) ic^^rL^^o^m^-nif^mmi^rzjEnm 

G, M, NtcSBftTSo ^*5> (3) iC&bfZ fa, fb, fc(i, g|» f fclfe 
V^TJilBf^Ca, Cb, C cte»JSt«flaS*^U IM^Cg a, gb, gc&HSi&g 
<D> ma, mb, mc(ii§[m©, na, nb, n c liH82&n O^^^-tl^n^Tc 

[0186] 

[^3] 



F(x) =2xfaxx 2 + (fb-fa)xx + fc 
G(x) = 2 x ga x x 2 + (gb-ga) x x + gc 



M(y) = 2 x ma x y 2 + (mb-ma) x y + mc 
N(y) = 2 x na x y 2 + (nb-na) xy + nc 



%4b\ w&&mm6 4i*mmikm6 3£r>m5fEtircmm (px, Py ) ^ ^co^m^ 
mm mt$ 6 5 % 0 

[0 1 8 7] 

^lt, ^psM^gp 6 5 ti, M&sm&G 4fc£omznrcmm.F, g, m, Ni:_hiB^ 

*S (px, py) ^Tjs^lMil^ffi^T, TffBOit (4) tJ:oT±IBJit (x t, y t 

[0 1 8 8] 
[3&4] 



- Y x {(1-py) x F(px)+py x G(px)+(1-px) x N(py)+ px x M(py)} 

(4) 



[0 18 9] 
[0 19 0] 



(27) 
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1212 5kt, i2 ic^nrzmm^'ev 6 o 2 ^^#gP2 9j&zf^— &ffimanffi3 

1 <DMf&Zt7r^m-?&Z>o 02 5(i, W»1S12^ (4X4) ^ 7 ^©1 6i 

[0191] 

EI 2 5 tc^^n?. J; -5 tc, HHfJ^-t U 6 0 2 (i-trl^^^ 6 7 IS^'^SiD 1 /c'lt 
^M50^tij, t^^A^t'J 71tB^iJ72, C^'J73, D^€U7 
4, M*E^t'J75m, 7*— *H5tf#g|5 2 9^fffiJ®Ig^8 0 A/Vy77 8 1 , B/^v 
7r8 2. C^y778 3> D^-y778 4, E;Vy778 5, ^ )\y^mW> 5 6 0 , 
M'-tl/7^9 6~9 95tiy 0 ^ * Jl<ft&m 5 6 0 fi-fe * 9 1 ~ 9 5 

CO 1 9 2] 

CCT\ 7*— ^^#g|32 9JC«, ±M(D^o^mm^^y P m^0 I mf^^5-D(D^^y 
T (A/^7778 1^BEA7778 5) B:tf*toS*r£ 5 OO-tr * 9 1—95^ ^ 
iS^ry^R-ea&S 4^©t^^ 9 6 — 9 9 C £ JC&S,, 
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